-- Logs begin at Mon 2021-12-20 08:35:01 UTC, end at Mon 2021-12-20 09:56:37 UTC. -- Dec 20 09:19:41.004115 dv-cinder-819082-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 20 09:19:41.012865 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 20 09:19:41.014840 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Dec 20 09:19:41 2021] *** Dec 20 09:19:41.014840 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 20 09:19:41.014840 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 20 09:19:41.014840 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: nodename: dv-cinder-819082-2-iscsi Dec 20 09:19:41.014840 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: machine: x86_64 Dec 20 09:19:41.014840 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: clock source: unix Dec 20 09:19:41.014840 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: pcre jit disabled Dec 20 09:19:41.014840 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: detected number of CPU cores: 4 Dec 20 09:19:41.014840 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: current working directory: / Dec 20 09:19:41.014840 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: detected binary path: /usr/bin/uwsgi-core Dec 20 09:19:41.015451 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: your processes number limit is 47680 Dec 20 09:19:41.015451 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: your memory page size is 4096 bytes Dec 20 09:19:41.015451 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: detected max file descriptor number: 2048 Dec 20 09:19:41.015451 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: lock engine: pthread robust mutexes Dec 20 09:19:41.015451 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: thunder lock: enabled Dec 20 09:19:41.015451 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 20 09:19:41.015451 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 20 09:19:41.060408 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: Python main interpreter initialized at 0x55ffdcaec9c0 Dec 20 09:19:41.060408 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: python threads support enabled Dec 20 09:19:41.060408 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: your server socket listen backlog is limited to 100 connections Dec 20 09:19:41.060408 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: your mercy for graceful operations on workers is 90 seconds Dec 20 09:19:41.060798 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: mapped 403077 bytes (393 KB) for 2 cores Dec 20 09:19:41.060886 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: *** Operational MODE: preforking *** Dec 20 09:19:41.061092 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: *** uWSGI is running in multiple interpreter mode *** Dec 20 09:19:41.061092 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: spawned uWSGI master process (pid: 102251) Dec 20 09:19:41.061291 dv-cinder-819082-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 20 09:19:41.061942 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: spawned uWSGI worker 1 (pid: 102252, cores: 1) Dec 20 09:19:41.062910 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: spawned uWSGI worker 2 (pid: 102253, cores: 1) Dec 20 09:19:41.062910 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 20 09:19:42.812431 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 20 09:19:42.812431 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: from cryptography.utils import int_from_bytes Dec 20 09:19:42.813063 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 20 09:19:42.813063 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: from cryptography.utils import int_from_bytes Dec 20 09:19:42.815635 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 20 09:19:42.815635 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: from cryptography.utils import int_from_bytes Dec 20 09:19:42.816137 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 20 09:19:42.816137 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: from cryptography.utils import int_from_bytes Dec 20 09:19:45.388286 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 20 09:19:45.388944 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 20 09:19:45.389044 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 20 09:19:45.389253 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 20 09:19:45.389626 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 20 09:19:45.389727 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 20 09:19:45.389827 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 20 09:19:45.389991 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 20 09:19:45.390133 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.390324 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.390438 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 20 09:19:45.390594 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 20 09:19:45.390682 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.390964 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.391060 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.391290 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.391384 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.391603 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.391712 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.392211 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.392299 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.392539 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.392626 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.392846 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.392954 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.393128 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.393241 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.393450 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.393538 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.393781 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.393877 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819082-2-iscsi {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.394042 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.394139 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.394360 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.394467 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.394683 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819082-2-iscsi {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.394770 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.395004 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.395104 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.395310 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.395399 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.395618 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.395747 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.395954 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.396050 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.396258 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.396455 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.396840 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.396980 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.397104 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.397213 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.397358 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.397486 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.397668 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.397806 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.397972 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.398126 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.398283 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.398440 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.398667 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.399351 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.399483 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.399703 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.399808 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.400030 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.400151 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.400348 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.400456 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.400733 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.400840 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819082-2-iscsi {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.401045 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.401134 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.401363 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.401497 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819082-2-iscsi {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.401684 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.401774 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.402055 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.402141 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.402368 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.402463 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.402711 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.402931 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.403028 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.403121 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.403363 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.403485 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.403700 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.403794 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.404021 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.404140 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.404327 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.404422 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.404652 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.404755 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.404971 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.405088 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.405278 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.405370 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.405593 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.405684 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.405893 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.405992 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.406200 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.406291 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.406531 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.406630 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.406816 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.406906 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.407073 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.407173 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.407386 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.407477 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.407636 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.407747 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.408399 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.408484 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.408578 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.408657 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.408726 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.408789 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.408853 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.408922 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.409129 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.409243 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.409425 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.409529 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.409699 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.409811 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.410019 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.410114 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.410327 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.410422 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.410636 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.410743 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.410943 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.411039 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.411247 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.411342 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.411552 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.411676 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.411882 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.411984 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.412191 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.412277 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.412497 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.412584 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.412813 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.412908 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.413125 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.413210 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.413444 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.413541 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.413751 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.413838 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.414068 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.414161 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.414412 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.414500 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.414735 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.414847 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.415041 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.415130 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.415368 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.415457 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.415695 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.415786 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.416009 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.416111 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.416328 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.416415 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.416649 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.416735 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.416955 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.417052 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.417259 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.417352 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.417565 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.417652 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.417883 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.417978 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.418165 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.418269 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.418474 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.418566 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.418745 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.418844 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.419045 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.419137 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.419351 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.419498 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.419678 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.419826 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.419996 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.420147 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.420286 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.420422 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.420596 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.420740 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.420886 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.421030 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.421174 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.421310 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.421483 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.421626 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.421789 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.421932 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.422096 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.422237 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.422384 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.422519 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.422691 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.422844 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.423001 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.423144 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.423290 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.423427 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.423592 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.423756 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.423931 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.424094 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.424233 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.424375 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.424547 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.424705 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.424935 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.425086 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.425224 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.425369 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.425514 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.425664 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.425801 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.425936 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.426081 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.426217 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.426365 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.426503 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.426689 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.426838 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.426984 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.427120 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.427256 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.427391 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.427534 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.427703 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.427847 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.427997 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.428145 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.428283 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.428420 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.428642 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.428790 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.428927 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.429070 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.429207 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.429343 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.429487 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.429631 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.429768 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.429904 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.430047 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.430212 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.430370 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.430520 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.430663 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.430801 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.430937 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.431082 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.431219 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.431379 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.431523 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.431726 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.431872 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.432021 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.432159 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.432295 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.432441 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.432588 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.432724 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.432896 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.433041 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.433207 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.433358 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.433496 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.433639 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.433818 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:19:45.433962 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.434154 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.434305 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.434488 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.434640 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.434830 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.435054 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.435199 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.435343 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.435480 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.435626 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.435815 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.435954 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.436113 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.436269 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.436420 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.436566 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.436711 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.436848 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.437038 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.437182 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.437333 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.437471 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.437646 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.437788 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.437956 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.438107 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.438260 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.438411 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.438578 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.438742 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.438893 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.439031 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.439209 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.439354 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.439524 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.439690 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.439867 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.440010 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.440160 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.440320 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.440480 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.440623 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.440809 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.440957 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.441127 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.441269 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.441436 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.441579 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.441777 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.441921 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.442113 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.442257 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.442412 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.442549 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.442734 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.442890 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.443029 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.443165 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.443351 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.443493 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.443703 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.443862 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.444008 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.444146 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.444290 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.444438 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.444604 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.444757 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.444902 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.445065 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.445278 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.445907 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.446051 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.446201 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.446338 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.446483 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.446652 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.446806 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.446944 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.447088 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.447250 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.447392 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.447556 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.447720 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.447875 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.448012 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.448172 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.448319 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.448482 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.448631 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.448793 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.448931 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.449103 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.449247 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.449435 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.449580 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.449727 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.449872 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.450039 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.450210 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.450349 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.450494 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.450633 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.450788 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.450926 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.451062 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.451235 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.451454 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.451594 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.451843 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.451983 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.452130 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.452290 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.452441 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.452578 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.452723 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.452874 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.453019 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.453156 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.453301 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.453445 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.453581 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.453725 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.453863 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.454000 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.454167 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.454305 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.454441 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.454596 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.454740 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.454888 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.455026 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.455169 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.455389 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.455531 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.455686 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.455844 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.455990 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.456150 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.456288 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.456424 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.456570 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.456715 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.456852 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.457024 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.457168 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.457340 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.457483 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.457629 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.457774 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.457939 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.458105 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.458252 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.458397 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.458544 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.458688 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.458828 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.458971 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.459117 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.459262 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.459400 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.459536 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.459731 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.459875 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.460024 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.460180 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.460318 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.460471 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.460625 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.460769 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.460906 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.461051 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.461742 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.461890 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.462028 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.462173 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.462338 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.462531 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.462674 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.462833 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.462972 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.463109 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.463260 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.463422 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.463567 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.463773 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.463930 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.464139 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.464299 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.464438 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.464575 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.464738 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.464893 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.465055 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.465208 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.465447 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.465599 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.465737 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.465872 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.466020 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.466158 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.466295 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.466439 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.466601 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.466747 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.466906 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.467044 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.467220 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.467365 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.467532 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.467719 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.467876 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.468013 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.468182 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.468325 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.468494 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.468636 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.468781 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.468952 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.469091 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.469227 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.469445 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.469607 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.469745 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.469889 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.470062 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.470207 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.470387 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.470540 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.470700 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.470844 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.470992 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.471128 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.471312 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.471465 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.471604 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.471770 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.471946 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.472090 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.472258 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.472418 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.472573 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.472754 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.472894 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.473046 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.473184 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.473329 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.473467 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.473612 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.473785 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.473930 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.474076 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.474213 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.474398 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.474541 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.474703 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.474857 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.475004 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.475142 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.475328 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.475496 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.475749 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.475896 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.476046 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.476183 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.476320 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.476456 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.476592 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.476763 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.476923 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.477061 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.477197 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.477334 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.477501 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.477654 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.477792 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.477942 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.478080 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.478216 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.478389 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.478542 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.478687 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.478834 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.478999 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.479149 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.479294 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.479441 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.479600 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.479769 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.479941 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.480086 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.480252 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.480476 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.480617 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.480754 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.480901 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.481039 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.481185 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.481322 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.481458 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.481601 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.481760 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.481904 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.482082 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.482227 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.482405 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.482549 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.482717 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.482871 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.483017 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.483156 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.483331 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.483475 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.483641 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.483840 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.483989 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.484128 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.484273 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.484417 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.484559 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.484713 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.484867 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.485012 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.485155 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.485300 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.485442 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.485594 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.485820 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.485971 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.486115 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.486266 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.486410 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.486562 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.486716 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.486867 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.487012 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.487156 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.487298 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.487450 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.487601 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.487773 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.487918 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.488073 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.488225 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.488379 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.488524 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.488682 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.488825 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.488968 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.489132 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.489286 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.489431 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.489591 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.489737 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.489880 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.490032 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.490176 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.490319 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.490463 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.490617 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.490760 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.490917 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.491069 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.491213 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.491356 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.491501 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.491954 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.492124 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.492317 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.492470 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.492639 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.492799 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.492953 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.493098 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.493242 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.493386 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.493563 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.493714 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.493891 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.494042 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.494217 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.494368 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.494511 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.494655 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.494818 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.494969 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.495114 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.495299 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.495444 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.495599 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.495778 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.496007 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.496157 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.496300 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.496444 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.496598 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.496752 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.496908 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.497052 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.497194 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.497345 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.497538 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.497689 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.497833 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.497976 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.498118 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.498269 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.498457 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.498606 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.498769 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.498928 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.499080 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.499224 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.499366 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.499515 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.499723 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.499876 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.500031 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.500176 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.500319 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.500470 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.500627 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.500782 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.500925 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.501070 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.501235 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.501385 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.501538 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.501690 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.501842 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.501987 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.502130 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.502273 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.502430 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.502576 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.502729 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.502873 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.503017 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.503170 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.503314 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.503458 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.503600 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.503773 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.503918 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.504107 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.504262 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.504413 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.504568 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.504712 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.504862 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.505015 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.505160 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.505303 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.505446 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.505589 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.505744 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.505888 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.506049 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.506262 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.506411 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.506564 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.506721 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.506866 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.507009 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.507159 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.507303 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.507454 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.507454 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.507765 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.507765 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.508564 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.508564 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.508837 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.509002 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.509147 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.509289 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.509433 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.509585 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.509738 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.509882 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.510032 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.510183 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.510327 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.510477 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.510632 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.510777 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.510930 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.511073 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.511223 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.511366 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.511518 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.511731 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.511883 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.512027 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.512170 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.512313 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.512469 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.512614 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.512757 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.512910 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.513053 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.513205 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.513350 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.513500 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.513645 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.513788 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.513931 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.514086 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.514230 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.514373 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.514518 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.514672 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.514825 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.514977 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.515121 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.515271 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.515422 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.515566 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.515741 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.515900 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.516046 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.516197 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.516422 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.516573 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.516741 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.517152 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.517297 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.517439 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.517583 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.517727 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.517879 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.518030 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.518180 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.518324 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.518467 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.518618 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.518772 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.518926 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.519078 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.519222 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.519372 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.519530 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.519708 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.519860 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.520004 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.520147 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.520289 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.520453 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.520606 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.520749 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.520904 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.521054 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.521198 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.521350 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.521494 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.521637 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.521787 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.521932 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.522083 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.522235 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.522386 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.522536 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.522686 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.522847 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.522847 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.523128 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.523272 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.523415 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.523599 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.524247 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.524365 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.524467 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.524551 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.524551 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.524744 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.524840 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.525048 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.525306 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.525405 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.525648 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.525749 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.525959 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.526061 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.526271 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.526369 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.526592 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.526682 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.526914 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.527014 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.527239 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.527329 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.527541 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.527631 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.527877 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.527990 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.528189 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.528279 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.528497 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.528598 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.528805 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.528894 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.529113 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.529201 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.529423 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.529518 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.529733 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.529823 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.530043 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.530137 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.530354 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.530446 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.530663 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.530753 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.530968 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.531055 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.531274 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.531371 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.531582 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.531692 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.531909 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.531999 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.532234 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.532331 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.532542 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.532638 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.532846 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.532933 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.533158 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.533258 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.533461 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.533613 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.533753 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.533890 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.534057 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.534203 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.534391 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.534527 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.534708 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.534854 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.535001 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.535145 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.535323 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.535466 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.535635 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.535799 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.535985 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.536121 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.536300 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.536437 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.536645 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.536746 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.536910 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.536998 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.537299 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.537385 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.537621 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.537709 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.537932 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.538029 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.538243 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.538338 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.538548 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.538636 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.538854 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.538967 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.539184 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.539311 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.539513 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.539632 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.539846 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.539974 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.540151 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.540302 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.540440 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.540599 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.540766 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.540905 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.541072 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.541234 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.541394 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.541538 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.541808 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.541937 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.542119 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.542247 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.542423 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.542561 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.542757 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.542885 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.543086 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.543219 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.543432 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.543560 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.543843 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.543973 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.544157 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.544285 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.544513 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.544641 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.544819 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.544947 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.545134 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.545261 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.545445 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.545586 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.545769 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.545905 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.546093 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.546221 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.546404 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.546545 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.546720 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.546877 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.547037 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.547364 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.547516 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.547692 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.547783 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.547873 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.547962 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.548051 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.548275 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.548364 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.548613 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.548699 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.548946 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.549043 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.549280 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.549368 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.549597 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.549694 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.549925 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.550024 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.550230 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.550328 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.550537 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.550639 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.550846 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.550949 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.551150 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.551271 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.551456 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.551606 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.551803 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.551957 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.552112 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.552277 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.552424 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.552594 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.552738 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.552904 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.553067 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.553217 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.553341 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.553547 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.553651 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.553861 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.553971 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.554176 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.554264 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.554495 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.554583 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.555315 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.555472 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.555616 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.555770 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.555953 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.556082 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.556284 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.556415 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.556594 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.556723 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.556931 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.557059 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.557193 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.557318 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.557486 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.557617 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.557789 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.557918 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.558132 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.558269 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.558439 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.558568 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.558760 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.558889 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.559068 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.559196 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.559378 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.559514 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.559706 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.559852 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.560044 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.560173 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.560362 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.560490 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.560676 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.560878 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.561006 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.561130 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.561305 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.561433 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.561610 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.561747 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.561912 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.562042 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.562222 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.562358 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.562526 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.562743 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.562886 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.563012 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.563136 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.563260 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.563393 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.563517 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.563719 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.563851 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.564024 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.564152 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.564327 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.564456 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.564645 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.564782 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.564949 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.565077 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.565270 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.565407 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.565577 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.565718 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.565878 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.566008 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.566181 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.566327 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.566482 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.566621 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.566809 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.566961 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.567161 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.567289 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.567413 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.567537 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.567751 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.567900 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.568064 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.568193 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.568372 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.568500 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.568680 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.568815 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.569002 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.569133 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.569319 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.569448 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.569636 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.569781 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.569951 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.570079 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.570267 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.570405 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.571158 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.571431 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.571571 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.571768 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.571947 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.572085 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.572380 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.572509 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.572704 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.572994 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.573122 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.573510 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.573655 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.573842 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.574106 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.574234 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.574450 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.574657 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.574799 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.575057 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.575241 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.575369 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.575691 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.575868 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.575998 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.576287 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.576445 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.576597 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.576920 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.577060 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.577262 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.577432 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.577562 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.577775 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.577903 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.578172 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.578322 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.578487 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.578671 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.578800 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.579005 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.579134 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.579335 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.579463 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.579678 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.579810 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.580015 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.580145 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.580344 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.580472 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.580669 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.580806 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.580980 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.581117 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.581291 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.581420 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.581601 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.581739 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.581912 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.582041 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.582222 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.582364 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.582532 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.582670 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.582841 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.582969 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.583151 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.583287 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.583463 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.583626 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.583801 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.583977 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.584130 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.584304 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.584442 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.584674 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.584805 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.584999 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.585139 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.585317 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.585455 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.585644 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.585840 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.585969 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.586176 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.586315 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.586509 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.586638 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.586833 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.586962 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.587158 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.587308 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.587506 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.587634 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.587783 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.587921 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.588109 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.588252 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.588414 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.588554 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.588716 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.588844 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.589024 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.589162 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.589330 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.589459 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.589630 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.589770 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.589949 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.590080 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.590257 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.590385 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.590558 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.590686 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.590872 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.591180 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.591310 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.591506 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.591731 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.591886 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.592094 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.592232 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.592370 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.592540 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.592694 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.592864 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.593018 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.593188 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.593317 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.593532 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.593660 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.593847 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.593984 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.594159 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.594281 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.594478 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.594606 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.594795 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.594933 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.595107 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.595241 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.595407 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.595534 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.595730 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.595872 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.596042 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.596170 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.596351 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.596496 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.596654 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.596782 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.596961 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.597201 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.597329 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.597559 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.597696 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.597865 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.598003 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.598168 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.598305 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.598470 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.598601 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.598781 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.598911 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.599083 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.599225 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.599383 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.599528 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.599700 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.599847 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.600007 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.600144 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.600319 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.600449 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.600621 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.600750 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.600929 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.601083 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.601230 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.601366 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.601540 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.601688 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.601867 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.602009 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.602176 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.602305 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.602476 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.602604 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.602789 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.602928 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.603089 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.603236 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.603390 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.603526 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.603719 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.603860 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.604028 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.604159 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.604348 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.604485 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.604658 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.604789 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.604965 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.605093 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.605278 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.605413 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.605589 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.605719 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.605908 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.606119 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.606256 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.606498 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.606636 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.606818 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.606945 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.607138 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.607272 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.607450 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.607594 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.607798 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.607928 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.608089 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.608217 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.608403 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.608538 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.608713 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.608846 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.609023 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.609149 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.609332 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.609527 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.609655 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.609855 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.609982 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.610188 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.610325 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.610508 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.610635 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.610813 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.610940 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.611122 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.611261 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.611428 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.611812 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.611934 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.612050 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.612186 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.612397 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.612524 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.612714 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.612855 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.613030 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.613169 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.613347 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.613477 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.613660 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.613788 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.613967 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.614103 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.614274 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.614411 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.614581 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.614717 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.614896 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.615037 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.615211 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.615340 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.615520 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.615646 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.615845 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.615968 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.616163 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.616290 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.616480 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.616621 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.616797 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.616939 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.617111 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.617239 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.617941 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.618080 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.618248 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.618378 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.618584 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.618713 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.618894 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.619032 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.619212 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.619349 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.619522 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.619652 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.619870 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.619999 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.620189 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.620318 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.620507 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.620636 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.620823 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.620960 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.621124 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.621252 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.621427 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.621571 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.621769 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.621896 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.622029 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.622155 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.622338 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.622467 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.622670 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.622799 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.622982 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.623118 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.623303 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.623441 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.623611 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.623770 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.623959 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.624087 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.624271 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.624413 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.624591 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.624728 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.624912 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.625047 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.625222 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.625364 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.625529 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.625697 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.625858 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.625994 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.626167 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.626297 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.626476 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.626612 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.626788 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.626914 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.627096 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.627207 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.627402 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.627508 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.627727 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.627829 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.628053 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.628144 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.628377 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.628467 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.628681 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.628779 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.629002 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.629098 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.629317 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.629406 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.629636 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.629735 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.629950 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.630040 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.630259 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.630355 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.630589 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.630686 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.630898 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.630994 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.631210 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.631299 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.631519 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.631617 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.631853 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.631966 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.632165 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.632254 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.632477 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.632567 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.632800 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.632888 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.633649 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.633747 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.633972 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.634062 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.634290 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.634378 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.634624 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.634726 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.634935 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.635035 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.635256 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.635345 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.635586 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.635711 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.635925 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.636014 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.636237 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.636342 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.636544 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.636659 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.636782 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 20 09:19:45.636872 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.637191 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.637510 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.637833 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.638152 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.638517 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.638793 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.639114 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.639447 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.639834 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.640170 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.640503 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.640858 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.641179 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.641530 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.642119 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.642439 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.642757 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.643069 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:19:45.643316 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 20 09:19:45.660104 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG oslo_db.sqlalchemy.engines [None req-84391946-a5d4-4955-9ab7-0e9d303ad928 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 09:19:45.668009 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_db.sqlalchemy.engines [None req-5a6cef6d-6195-4ccd-804e-1dd6b9c99754 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 09:19:45.725625 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.context [None req-84391946-a5d4-4955-9ab7-0e9d303ad928 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6e0e0af-77e8-4802-8159-a0a3ab8beb6c(cell1) {{(pid=102252) load_cells /opt/stack/nova/nova/context.py:464}} Dec 20 09:19:45.730437 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG oslo_concurrency.lockutils [None req-84391946-a5d4-4955-9ab7-0e9d303ad928 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:19:45.732039 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG oslo_concurrency.lockutils [None req-84391946-a5d4-4955-9ab7-0e9d303ad928 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:19:45.732840 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG oslo_concurrency.lockutils [None req-84391946-a5d4-4955-9ab7-0e9d303ad928 None None] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:19:45.734751 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG oslo_concurrency.lockutils [None req-84391946-a5d4-4955-9ab7-0e9d303ad928 None None] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:19:45.735277 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.context [None req-5a6cef6d-6195-4ccd-804e-1dd6b9c99754 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6e0e0af-77e8-4802-8159-a0a3ab8beb6c(cell1) {{(pid=102253) load_cells /opt/stack/nova/nova/context.py:464}} Dec 20 09:19:45.739617 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_concurrency.lockutils [None req-5a6cef6d-6195-4ccd-804e-1dd6b9c99754 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:19:45.741250 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_concurrency.lockutils [None req-5a6cef6d-6195-4ccd-804e-1dd6b9c99754 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:19:45.742062 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_concurrency.lockutils [None req-5a6cef6d-6195-4ccd-804e-1dd6b9c99754 None None] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:19:45.744087 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_concurrency.lockutils [None req-5a6cef6d-6195-4ccd-804e-1dd6b9c99754 None None] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:19:45.745280 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG oslo_db.sqlalchemy.engines [None req-84391946-a5d4-4955-9ab7-0e9d303ad928 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 09:19:45.746089 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG oslo_db.sqlalchemy.engines [None req-84391946-a5d4-4955-9ab7-0e9d303ad928 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 09:19:45.756201 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_db.sqlalchemy.engines [None req-5a6cef6d-6195-4ccd-804e-1dd6b9c99754 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 09:19:45.758506 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_db.sqlalchemy.engines [None req-5a6cef6d-6195-4ccd-804e-1dd6b9c99754 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 09:19:45.908611 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG oslo_db.sqlalchemy.engines [None req-84391946-a5d4-4955-9ab7-0e9d303ad928 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 09:19:45.919600 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_db.sqlalchemy.engines [None req-5a6cef6d-6195-4ccd-804e-1dd6b9c99754 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 09:19:46.321208 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: WARNING keystonemiddleware.auth_token [None req-84391946-a5d4-4955-9ab7-0e9d303ad928 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 20 09:19:46.327783 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: WARNING keystonemiddleware.auth_token [None req-84391946-a5d4-4955-9ab7-0e9d303ad928 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 20 09:19:46.334016 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: WARNING keystonemiddleware.auth_token [None req-5a6cef6d-6195-4ccd-804e-1dd6b9c99754 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 20 09:19:46.341127 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: WARNING keystonemiddleware.auth_token [None req-5a6cef6d-6195-4ccd-804e-1dd6b9c99754 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 20 09:19:46.678870 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: WARNING keystonemiddleware.auth_token [None req-84391946-a5d4-4955-9ab7-0e9d303ad928 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 20 09:19:46.684741 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: WARNING keystonemiddleware.auth_token [None req-84391946-a5d4-4955-9ab7-0e9d303ad928 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 20 09:19:46.687004 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: WARNING keystonemiddleware.auth_token [None req-5a6cef6d-6195-4ccd-804e-1dd6b9c99754 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 20 09:19:46.689874 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ffdcaec9c0 pid: 102252 (default app) Dec 20 09:19:46.692021 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-84391946-a5d4-4955-9ab7-0e9d303ad928 None None] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:19:46.693225 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-84391946-a5d4-4955-9ab7-0e9d303ad928 None None] 10.222.0.62 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001795 Dec 20 09:19:46.693637 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 788 bytes} [Mon Dec 20 09:19:46 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:19:46.694665 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: WARNING keystonemiddleware.auth_token [None req-5a6cef6d-6195-4ccd-804e-1dd6b9c99754 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 20 09:19:46.700507 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ffdcaec9c0 pid: 102253 (default app) Dec 20 09:21:11.272866 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-84391946-a5d4-4955-9ab7-0e9d303ad928 None None] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:21:11.274468 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-84391946-a5d4-4955-9ab7-0e9d303ad928 None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002027 Dec 20 09:21:11.275022 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 2/2] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 20 09:21:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:21:11.708263 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-1cabb3a8-241b-4355-83d0-1aca722efd70 admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:21:11.737896 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-1cabb3a8-241b-4355-83d0-1aca722efd70 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.455770 Dec 20 09:21:11.738757 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 1/3] 10.222.0.62 () {60 vars in 1291 bytes} [Mon Dec 20 09:21:11 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:21:14.163153 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-84391946-a5d4-4955-9ab7-0e9d303ad928 None None] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:21:14.164213 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-84391946-a5d4-4955-9ab7-0e9d303ad928 None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002014 Dec 20 09:21:14.164616 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 3/4] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 20 09:21:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:21:14.229254 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-73425f77-9ef5-4766-965b-eb7475dc24ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "swap": 0, "id": "c1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "name": "cirros256"}} {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:21:14.247916 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:21:14.247916 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: warnings.warn(msg) Dec 20 09:21:14.350061 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-73425f77-9ef5-4766-965b-eb7475dc24ca admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.179143 Dec 20 09:21:14.350943 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 2/5] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Dec 20 09:21:14 2021] POST /compute/v2.1/flavors => generated 407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:21:14.575764 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-1a4a83f7-04da-44c2-bbbb-fc1ccc8656d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:21:14.578084 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:21:14.578084 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: warnings.warn(msg) Dec 20 09:21:14.673844 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-1a4a83f7-04da-44c2-bbbb-fc1ccc8656d7 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.314526 Dec 20 09:21:14.674669 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 4/6] 10.222.0.62 () {64 vars in 1335 bytes} [Mon Dec 20 09:21:14 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:21:17.074639 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-73425f77-9ef5-4766-965b-eb7475dc24ca admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:21:17.076404 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-73425f77-9ef5-4766-965b-eb7475dc24ca admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002194 Dec 20 09:21:17.076810 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 3/7] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 20 09:21:17 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:21:17.194965 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-400a5da9-94fa-4570-8f98-c1edaee67637 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d1", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "disk": 5, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:21:17.219331 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:21:17.219331 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: warnings.warn(msg) Dec 20 09:21:17.301421 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-400a5da9-94fa-4570-8f98-c1edaee67637 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.217913 Dec 20 09:21:17.302045 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 5/8] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Dec 20 09:21:17 2021] POST /compute/v2.1/flavors => generated 404 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:21:17.314233 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-84033559-8667-411e-97b6-8a4884581ca4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:21:17.315787 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:21:17.315787 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: warnings.warn(msg) Dec 20 09:21:17.437935 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-84033559-8667-411e-97b6-8a4884581ca4 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.127539 Dec 20 09:21:17.438620 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 4/9] 10.222.0.62 () {64 vars in 1335 bytes} [Mon Dec 20 09:21:17 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:21:19.877642 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-400a5da9-94fa-4570-8f98-c1edaee67637 admin admin] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:21:19.879645 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-400a5da9-94fa-4570-8f98-c1edaee67637 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002423 Dec 20 09:21:19.880078 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 6/10] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 20 09:21:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:21:19.940895 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-59596a0e-73da-41f4-8c94-5f23adaef812 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "swap": 0, "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "vcpus": 1, "id": "d2"}} {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:21:20.032116 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-59596a0e-73da-41f4-8c94-5f23adaef812 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.145321 Dec 20 09:21:20.032765 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 5/11] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Dec 20 09:21:19 2021] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:21:20.045439 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-f3dfb723-4d34-48a8-80b5-1f3a68e3441f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:21:20.160655 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-f3dfb723-4d34-48a8-80b5-1f3a68e3441f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118777 Dec 20 09:21:20.161323 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 7/12] 10.222.0.62 () {64 vars in 1335 bytes} [Mon Dec 20 09:21:20 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:21:22.555557 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-59596a0e-73da-41f4-8c94-5f23adaef812 admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:21:22.556619 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-59596a0e-73da-41f4-8c94-5f23adaef812 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Dec 20 09:21:22.557021 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 6/13] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 20 09:21:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:21:22.631652 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-326e87ee-de4c-4c16-acce-453382ea5fa6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 10, "name": "ds2G", "ram": 2048, "id": "d3", "rxtx_factor": 1.0, "swap": 0}} {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:21:22.705741 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-326e87ee-de4c-4c16-acce-453382ea5fa6 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141948 Dec 20 09:21:22.715722 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 8/14] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Dec 20 09:21:22 2021] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:21:22.726035 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-3d19322a-8f13-4c90-b7f9-796caaf3d974 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:21:22.807719 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-3d19322a-8f13-4c90-b7f9-796caaf3d974 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088983 Dec 20 09:21:22.808425 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 7/15] 10.222.0.62 () {64 vars in 1335 bytes} [Mon Dec 20 09:21:22 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:21:25.198478 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-326e87ee-de4c-4c16-acce-453382ea5fa6 admin admin] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:21:25.199513 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-326e87ee-de4c-4c16-acce-453382ea5fa6 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Dec 20 09:21:25.199946 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 9/16] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 20 09:21:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:21:25.257543 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-10e5f8f6-8d2b-4684-b1bd-2d680d687171 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "rxtx_factor": 1.0, "id": "d4"}} {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:21:25.358453 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-10e5f8f6-8d2b-4684-b1bd-2d680d687171 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.152086 Dec 20 09:21:25.359236 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 8/17] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Dec 20 09:21:25 2021] POST /compute/v2.1/flavors => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:21:25.372125 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-411d3ffd-b796-4a61-9e65-924996f3d49f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:21:25.464547 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-411d3ffd-b796-4a61-9e65-924996f3d49f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096112 Dec 20 09:21:25.465104 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 10/18] 10.222.0.62 () {64 vars in 1335 bytes} [Mon Dec 20 09:21:25 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:21:27.905098 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-10e5f8f6-8d2b-4684-b1bd-2d680d687171 admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:21:27.906123 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-10e5f8f6-8d2b-4684-b1bd-2d680d687171 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Dec 20 09:21:27.906531 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 9/19] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 20 09:21:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:21:27.986965 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-133f7b3f-3fec-49a0-9930-f1953e99515d admin admin] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:21:28.010306 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-133f7b3f-3fec-49a0-9930-f1953e99515d admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.096868 Dec 20 09:21:28.010804 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 11/20] 10.222.0.62 () {60 vars in 1291 bytes} [Mon Dec 20 09:21:27 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:21:30.437140 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-10e5f8f6-8d2b-4684-b1bd-2d680d687171 admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:21:30.438621 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-10e5f8f6-8d2b-4684-b1bd-2d680d687171 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002020 Dec 20 09:21:30.439116 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 10/21] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 20 09:21:30 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:21:30.498240 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-482f0fac-0ca5-4cc8-a475-53bed059bc9b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:21:30.569373 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-482f0fac-0ca5-4cc8-a475-53bed059bc9b admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.123771 Dec 20 09:21:30.569933 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 12/22] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Dec 20 09:21:30 2021] POST /compute/v2.1/flavors => generated 402 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:21:30.584973 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-24d1b410-7b58-4964-a150-2ff6c0a28349 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:21:30.694022 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-24d1b410-7b58-4964-a150-2ff6c0a28349 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112487 Dec 20 09:21:30.694956 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 11/23] 10.222.0.62 () {64 vars in 1332 bytes} [Mon Dec 20 09:21:30 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:21:33.101340 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-482f0fac-0ca5-4cc8-a475-53bed059bc9b admin admin] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:21:33.102336 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-482f0fac-0ca5-4cc8-a475-53bed059bc9b admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Dec 20 09:21:33.102754 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 13/24] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 20 09:21:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:21:33.161599 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-bac364d1-fe21-4b65-90f4-878bda7bcc86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "m1.small", "os-flavor-access:is_public": true, "swap": 0, "id": "2", "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:21:33.243313 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-bac364d1-fe21-4b65-90f4-878bda7bcc86 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.134268 Dec 20 09:21:33.244088 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 12/25] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Dec 20 09:21:33 2021] POST /compute/v2.1/flavors => generated 405 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:21:33.256958 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-694e669b-579c-45e5-955b-f653685c6304 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:21:33.343783 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-694e669b-579c-45e5-955b-f653685c6304 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091043 Dec 20 09:21:33.351742 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 14/26] 10.222.0.62 () {64 vars in 1332 bytes} [Mon Dec 20 09:21:33 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:21:35.771804 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-bac364d1-fe21-4b65-90f4-878bda7bcc86 admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:21:35.772914 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-bac364d1-fe21-4b65-90f4-878bda7bcc86 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Dec 20 09:21:35.773407 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 13/27] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 20 09:21:35 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:21:35.835357 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-26111888-fe0b-4f7d-b47d-54b0c60ecc79 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "id": "3", "name": "m1.medium", "swap": 0, "ram": 4096, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:21:35.911108 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-26111888-fe0b-4f7d-b47d-54b0c60ecc79 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.131266 Dec 20 09:21:35.918451 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 15/28] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Dec 20 09:21:35 2021] POST /compute/v2.1/flavors => generated 406 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:21:35.924670 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-c6ad2f20-969a-4f1b-8130-b514d9acaa21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:21:36.046148 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-c6ad2f20-969a-4f1b-8130-b514d9acaa21 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125290 Dec 20 09:21:36.046714 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 14/29] 10.222.0.62 () {64 vars in 1332 bytes} [Mon Dec 20 09:21:35 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:21:38.494053 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-26111888-fe0b-4f7d-b47d-54b0c60ecc79 admin admin] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:21:38.495349 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-26111888-fe0b-4f7d-b47d-54b0c60ecc79 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001876 Dec 20 09:21:38.495860 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 16/30] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 20 09:21:38 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:21:38.563327 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-dbddac6f-c647-40da-a62b-2ec2ae405226 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "rxtx_factor": 1.0, "name": "m1.large", "swap": 0, "vcpus": 4}} {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:21:38.659919 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-dbddac6f-c647-40da-a62b-2ec2ae405226 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.156988 Dec 20 09:21:38.660471 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 15/31] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Dec 20 09:21:38 2021] POST /compute/v2.1/flavors => generated 405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:21:38.673345 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-d4ed8478-2853-4882-ba61-7750906476e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:21:38.784040 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-d4ed8478-2853-4882-ba61-7750906476e5 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114435 Dec 20 09:21:38.785235 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 17/32] 10.222.0.62 () {64 vars in 1332 bytes} [Mon Dec 20 09:21:38 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:21:41.218977 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-dbddac6f-c647-40da-a62b-2ec2ae405226 admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:21:41.220024 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-dbddac6f-c647-40da-a62b-2ec2ae405226 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Dec 20 09:21:41.220687 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 16/33] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 20 09:21:41 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:21:41.282012 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-45969cf9-32ca-4990-91e3-59ce4bc304cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "5", "disk": 160, "vcpus": 8, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "name": "m1.xlarge"}} {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:21:41.351470 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-45969cf9-32ca-4990-91e3-59ce4bc304cc admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.123781 Dec 20 09:21:41.358866 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 18/34] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Dec 20 09:21:41 2021] POST /compute/v2.1/flavors => generated 408 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:21:41.364092 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-f4110e40-be8b-4eeb-9ce1-f5a9de75e6c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:21:41.447403 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-f4110e40-be8b-4eeb-9ce1-f5a9de75e6c8 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086864 Dec 20 09:21:41.448240 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 17/35] 10.222.0.62 () {64 vars in 1332 bytes} [Mon Dec 20 09:21:41 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:22:03.243957 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-45969cf9-32ca-4990-91e3-59ce4bc304cc admin admin] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:22:03.244985 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-45969cf9-32ca-4990-91e3-59ce4bc304cc admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Dec 20 09:22:03.245381 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 19/36] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 20 09:22:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:22:03.305628 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-9e5e03c1-0c07-42b3-aaa6-d7c395f75026 admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:22:03.322151 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-9e5e03c1-0c07-42b3-aaa6-d7c395f75026 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070365 Dec 20 09:22:03.322686 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 18/37] 10.222.0.62 () {60 vars in 1291 bytes} [Mon Dec 20 09:22:03 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:22:04.924320 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-45969cf9-32ca-4990-91e3-59ce4bc304cc admin admin] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:22:04.925304 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-45969cf9-32ca-4990-91e3-59ce4bc304cc admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Dec 20 09:22:04.925695 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 20/38] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 20 09:22:04 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:22:05.126835 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-3f126c9f-8565-4a7d-9727-c807bb3573ac admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:22:05.132947 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.wsgi [None req-3f126c9f-8565-4a7d-9727-c807bb3573ac admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 20 09:22:05.133558 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-3f126c9f-8565-4a7d-9727-c807bb3573ac admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:22:05.134292 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-3f126c9f-8565-4a7d-9727-c807bb3573ac admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057445 Dec 20 09:22:05.134792 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 19/39] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Dec 20 09:22:05 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 20 09:22:05.144521 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-0c7a5562-37c5-4022-9a76-38ee410ff8f4 admin admin] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:22:05.164641 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-0c7a5562-37c5-4022-9a76-38ee410ff8f4 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023563 Dec 20 09:22:05.165152 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 21/40] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Dec 20 09:22:05 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:22:05.175144 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-6bc51a55-ca18-49e6-9570-ae1bb4498172 admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:22:05.195862 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-6bc51a55-ca18-49e6-9570-ae1bb4498172 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024158 Dec 20 09:22:05.196392 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 20/41] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Dec 20 09:22:05 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:22:05.206004 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-adea96ce-4b3c-431e-8cbd-f66653297db9 admin admin] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:22:05.211301 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.wsgi [None req-adea96ce-4b3c-431e-8cbd-f66653297db9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 20 09:22:05.211911 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-adea96ce-4b3c-431e-8cbd-f66653297db9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:22:05.212699 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-adea96ce-4b3c-431e-8cbd-f66653297db9 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010145 Dec 20 09:22:05.213181 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 22/42] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Dec 20 09:22:05 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 20 09:22:06.697813 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-6bc51a55-ca18-49e6-9570-ae1bb4498172 admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:22:06.698813 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-6bc51a55-ca18-49e6-9570-ae1bb4498172 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Dec 20 09:22:06.699218 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 21/43] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 20 09:22:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:22:06.896113 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-87305d64-d674-44d7-932b-ed57759bfe32 admin admin] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:22:06.901762 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.wsgi [None req-87305d64-d674-44d7-932b-ed57759bfe32 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 20 09:22:06.902327 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-87305d64-d674-44d7-932b-ed57759bfe32 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:22:06.903119 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-87305d64-d674-44d7-932b-ed57759bfe32 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059016 Dec 20 09:22:06.903624 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 23/44] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Dec 20 09:22:06 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 20 09:22:06.913756 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-f8980139-243b-4bda-bd78-bf4d35d3b9ea admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:22:06.927512 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-f8980139-243b-4bda-bd78-bf4d35d3b9ea admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017755 Dec 20 09:22:06.928003 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 22/45] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Dec 20 09:22:06 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:22:06.937378 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-e5241545-dfdc-4f29-85c6-660ec0626cd6 admin admin] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:22:06.950318 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-e5241545-dfdc-4f29-85c6-660ec0626cd6 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016268 Dec 20 09:22:06.950825 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 24/46] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Dec 20 09:22:06 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:22:06.960299 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-3d5fdfe8-fd91-4f65-b7f3-7f7c95aa4362 admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:22:06.965332 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.wsgi [None req-3d5fdfe8-fd91-4f65-b7f3-7f7c95aa4362 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 20 09:22:06.965891 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-3d5fdfe8-fd91-4f65-b7f3-7f7c95aa4362 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:22:06.966662 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-3d5fdfe8-fd91-4f65-b7f3-7f7c95aa4362 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009803 Dec 20 09:22:06.967144 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 23/47] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Dec 20 09:22:06 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 20 09:22:08.456345 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-e5241545-dfdc-4f29-85c6-660ec0626cd6 admin admin] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:22:08.457956 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-e5241545-dfdc-4f29-85c6-660ec0626cd6 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Dec 20 09:22:08.458352 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 25/48] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 20 09:22:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:22:08.649822 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-422feca4-f076-4a6a-bbdd-36976b7553eb admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:22:08.654959 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.wsgi [None req-422feca4-f076-4a6a-bbdd-36976b7553eb admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 20 09:22:08.655516 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-422feca4-f076-4a6a-bbdd-36976b7553eb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:22:08.656328 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-422feca4-f076-4a6a-bbdd-36976b7553eb admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057360 Dec 20 09:22:08.656826 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 24/49] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Dec 20 09:22:08 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 20 09:22:08.666493 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-12e6ad0e-22c6-4816-919a-477ab0be2aa2 admin admin] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:22:08.680039 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-12e6ad0e-22c6-4816-919a-477ab0be2aa2 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017036 Dec 20 09:22:08.680555 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 26/50] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Dec 20 09:22:08 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:22:08.692343 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-19a02565-200c-4811-9984-63177058f5f3 admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:22:08.704958 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-19a02565-200c-4811-9984-63177058f5f3 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018324 Dec 20 09:22:08.705469 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 25/51] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Dec 20 09:22:08 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:22:08.715074 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-1da9caf4-fc88-47a8-9a5a-b5be7848a25a admin admin] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:22:08.720217 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.wsgi [None req-1da9caf4-fc88-47a8-9a5a-b5be7848a25a admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 20 09:22:08.720777 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-1da9caf4-fc88-47a8-9a5a-b5be7848a25a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:22:08.721561 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-1da9caf4-fc88-47a8-9a5a-b5be7848a25a admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009963 Dec 20 09:22:08.722049 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 27/52] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Dec 20 09:22:08 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 20 09:22:10.191507 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-19a02565-200c-4811-9984-63177058f5f3 admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:22:10.193036 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-19a02565-200c-4811-9984-63177058f5f3 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002038 Dec 20 09:22:10.193424 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 26/53] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 20 09:22:10 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:22:10.383376 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-66316cb3-059d-46c1-82c6-41f2da82b177 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:22:10.487144 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-66316cb3-059d-46c1-82c6-41f2da82b177 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.156518 Dec 20 09:22:10.487741 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 28/54] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Dec 20 09:22:10 2021] POST /compute/v2.1/flavors => generated 404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:22:11.981934 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-19a02565-200c-4811-9984-63177058f5f3 admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:22:11.982933 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-19a02565-200c-4811-9984-63177058f5f3 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Dec 20 09:22:11.983326 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 27/55] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 20 09:22:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:22:12.174384 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-49af1482-9a27-45b0-ae81-6ef880fa1658 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:22:12.264302 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-49af1482-9a27-45b0-ae81-6ef880fa1658 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.140372 Dec 20 09:22:12.264776 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 29/56] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Dec 20 09:22:12 2021] POST /compute/v2.1/flavors => generated 405 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:22:13.755090 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-19a02565-200c-4811-9984-63177058f5f3 admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:22:13.756117 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-19a02565-200c-4811-9984-63177058f5f3 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Dec 20 09:22:13.756516 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 28/57] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 20 09:22:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:22:13.947860 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-71ed2c8e-48ab-48ce-a573-ba2b1b46ef57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:22:13.996221 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-71ed2c8e-48ab-48ce-a573-ba2b1b46ef57 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.099408 Dec 20 09:22:13.996787 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 30/58] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Dec 20 09:22:13 2021] POST /compute/v2.1/flavors => generated 407 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 09:22:15.474928 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-19a02565-200c-4811-9984-63177058f5f3 admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:22:15.475958 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-19a02565-200c-4811-9984-63177058f5f3 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Dec 20 09:22:15.476386 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 29/59] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 20 09:22:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:22:15.666575 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-f7f88faa-43d6-4e73-82e5-d8223b4f4e68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:22:15.739712 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-f7f88faa-43d6-4e73-82e5-d8223b4f4e68 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.124062 Dec 20 09:22:15.740266 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 31/60] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Dec 20 09:22:15 2021] POST /compute/v2.1/flavors => generated 409 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:22:17.224839 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-19a02565-200c-4811-9984-63177058f5f3 admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:22:17.225836 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-19a02565-200c-4811-9984-63177058f5f3 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Dec 20 09:22:17.226223 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 30/61] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 20 09:22:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:22:17.413148 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-d523f018-d935-4413-88ef-3975b31f6ded admin admin] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:22:17.432617 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-d523f018-d935-4413-88ef-3975b31f6ded admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070858 Dec 20 09:22:17.433163 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 32/62] 10.222.0.62 () {60 vars in 1202 bytes} [Mon Dec 20 09:22:17 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:23:05.372642 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-19a02565-200c-4811-9984-63177058f5f3 admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:23:05.373635 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-19a02565-200c-4811-9984-63177058f5f3 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Dec 20 09:23:05.374023 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 31/63] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 20 09:23:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:23:05.435133 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-37f2d0a5-0c16-468b-8a4d-77aa351884d2 admin admin] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:23:05.455177 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-37f2d0a5-0c16-468b-8a4d-77aa351884d2 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074329 Dec 20 09:23:05.455733 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 33/64] 10.222.0.62 () {60 vars in 1291 bytes} [Mon Dec 20 09:23:05 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:23:05.477659 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-621e2508-b70b-4f6c-9c3a-aa4021420ea5 admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:23:05.485248 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-621e2508-b70b-4f6c-9c3a-aa4021420ea5 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011142 Dec 20 09:23:05.486302 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 32/65] 10.222.0.62 () {60 vars in 1282 bytes} [Mon Dec 20 09:23:05 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:23:05.497716 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-2e1fe733-88e4-48ce-aca3-d8beab603605 admin admin] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:23:05.505798 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-2e1fe733-88e4-48ce-aca3-d8beab603605 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011477 Dec 20 09:23:05.506294 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 34/66] 10.222.0.62 () {60 vars in 1285 bytes} [Mon Dec 20 09:23:05 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:23:05.517762 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-02faf043-cfce-4303-8a7b-7a43dd7eff78 admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:23:05.525050 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-02faf043-cfce-4303-8a7b-7a43dd7eff78 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010703 Dec 20 09:23:05.525557 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 33/67] 10.222.0.62 () {60 vars in 1285 bytes} [Mon Dec 20 09:23:05 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:23:05.536519 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-6ba5530a-4a2d-49d4-b27d-b25b09e5ec74 admin admin] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:23:05.543839 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-6ba5530a-4a2d-49d4-b27d-b25b09e5ec74 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010516 Dec 20 09:23:05.544343 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 35/68] 10.222.0.62 () {60 vars in 1282 bytes} [Mon Dec 20 09:23:05 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:24:39.039580 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-17b18e66-cc88-41a9-9e3d-f2ca935002a1 tempest-verify_tempest_config-337026294 tempest-verify_tempest_config-337026294-project] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:24:39.041637 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-17b18e66-cc88-41a9-9e3d-f2ca935002a1 tempest-verify_tempest_config-337026294 tempest-verify_tempest_config-337026294-project] 10.222.0.62 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105303 Dec 20 09:24:39.042169 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 34/69] 10.222.0.62 () {58 vars in 1133 bytes} [Mon Dec 20 09:24:38 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:26:13.492363 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-6ba5530a-4a2d-49d4-b27d-b25b09e5ec74 admin admin] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:26:13.493373 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-6ba5530a-4a2d-49d4-b27d-b25b09e5ec74 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Dec 20 09:26:13.493810 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 36/70] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 20 09:26:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:26:13.750872 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-77a826b3-b2b6-416d-bf5b-a909c37d77b8 admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:26:13.752083 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:26:13.752083 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: warnings.warn(msg) Dec 20 09:26:13.753644 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_concurrency.lockutils [None req-77a826b3-b2b6-416d-bf5b-a909c37d77b8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:26:13.754091 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_concurrency.lockutils [None req-77a826b3-b2b6-416d-bf5b-a909c37d77b8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:26:13.754918 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_concurrency.lockutils [None req-77a826b3-b2b6-416d-bf5b-a909c37d77b8 admin admin] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:26:13.755347 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_concurrency.lockutils [None req-77a826b3-b2b6-416d-bf5b-a909c37d77b8 admin admin] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:26:13.788052 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-77a826b3-b2b6-416d-bf5b-a909c37d77b8 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.148670 Dec 20 09:26:13.788612 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 35/71] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Dec 20 09:26:13 2021] GET /compute/v2.1/os-services => generated 791 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:26:15.297209 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-6ba5530a-4a2d-49d4-b27d-b25b09e5ec74 admin admin] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:26:15.298213 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-6ba5530a-4a2d-49d4-b27d-b25b09e5ec74 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Dec 20 09:26:15.298611 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 37/72] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 20 09:26:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:26:15.488328 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-ac101e21-22a5-48c6-8307-17f615386bdc admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:26:15.489502 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:26:15.489502 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: warnings.warn(msg) Dec 20 09:26:15.491007 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_concurrency.lockutils [None req-ac101e21-22a5-48c6-8307-17f615386bdc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:26:15.491459 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_concurrency.lockutils [None req-ac101e21-22a5-48c6-8307-17f615386bdc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:26:15.492292 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_concurrency.lockutils [None req-ac101e21-22a5-48c6-8307-17f615386bdc admin admin] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:26:15.492729 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_concurrency.lockutils [None req-ac101e21-22a5-48c6-8307-17f615386bdc admin admin] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:26:15.513019 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-ac101e21-22a5-48c6-8307-17f615386bdc admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075073 Dec 20 09:26:15.513503 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 36/73] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Dec 20 09:26:15 2021] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:26:27.436657 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-6ba5530a-4a2d-49d4-b27d-b25b09e5ec74 admin admin] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:26:27.437653 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-6ba5530a-4a2d-49d4-b27d-b25b09e5ec74 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Dec 20 09:26:27.438047 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 38/74] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 20 09:26:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:26:27.633796 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-e4bdcb1e-e62c-432f-a772-97ecd1dd5bff admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:26:27.635517 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:26:27.635517 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: warnings.warn(msg) Dec 20 09:26:27.637093 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_concurrency.lockutils [None req-e4bdcb1e-e62c-432f-a772-97ecd1dd5bff admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:26:27.637537 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_concurrency.lockutils [None req-e4bdcb1e-e62c-432f-a772-97ecd1dd5bff admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:26:27.638341 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_concurrency.lockutils [None req-e4bdcb1e-e62c-432f-a772-97ecd1dd5bff admin admin] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:26:27.638777 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_concurrency.lockutils [None req-e4bdcb1e-e62c-432f-a772-97ecd1dd5bff admin admin] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:26:27.664235 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-e4bdcb1e-e62c-432f-a772-97ecd1dd5bff admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082177 Dec 20 09:26:27.664719 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 37/75] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Dec 20 09:26:27 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:26:29.185787 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: DEBUG nova.api.openstack.wsgi [None req-6ba5530a-4a2d-49d4-b27d-b25b09e5ec74 admin admin] Calling method '>' {{(pid=102252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:26:29.186812 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: INFO nova.api.openstack.requestlog [None req-6ba5530a-4a2d-49d4-b27d-b25b09e5ec74 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Dec 20 09:26:29.187234 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: [pid: 102252|app: 0|req: 39/76] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 20 09:26:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:26:29.389964 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG nova.api.openstack.wsgi [None req-de99beda-b7c6-41ad-9989-574903addb82 admin admin] Calling method '>' {{(pid=102253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:26:29.391152 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:26:29.391152 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: warnings.warn(msg) Dec 20 09:26:29.392726 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_concurrency.lockutils [None req-de99beda-b7c6-41ad-9989-574903addb82 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:26:29.393176 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_concurrency.lockutils [None req-de99beda-b7c6-41ad-9989-574903addb82 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:26:29.394023 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_concurrency.lockutils [None req-de99beda-b7c6-41ad-9989-574903addb82 admin admin] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:26:29.394402 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: DEBUG oslo_concurrency.lockutils [None req-de99beda-b7c6-41ad-9989-574903addb82 admin admin] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:26:29.414993 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: INFO nova.api.openstack.requestlog [None req-de99beda-b7c6-41ad-9989-574903addb82 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076705 Dec 20 09:26:29.415546 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: [pid: 102253|app: 0|req: 38/77] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Dec 20 09:26:29 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:27:30.202805 dv-cinder-819082-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 20 09:27:30.203411 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: Mon Dec 20 09:27:30 2021 - graceful shutdown triggered... Dec 20 09:27:30.203910 dv-cinder-819082-2-iscsi devstack@n-api.service[102252]: Gracefully killing worker 1 (pid: 102252)... Dec 20 09:27:30.204840 dv-cinder-819082-2-iscsi devstack@n-api.service[102253]: Gracefully killing worker 2 (pid: 102253)... Dec 20 09:27:31.204267 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: worker 1 buried after 1 seconds Dec 20 09:27:31.204831 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: worker 2 buried after 1 seconds Dec 20 09:27:31.204831 dv-cinder-819082-2-iscsi devstack@n-api.service[102251]: goodbye to uWSGI. Dec 20 09:27:31.205852 dv-cinder-819082-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 20 09:27:31.206414 dv-cinder-819082-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 20 09:27:31.209176 dv-cinder-819082-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 20 09:27:31.218247 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 20 09:27:31.220936 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Dec 20 09:27:31 2021] *** Dec 20 09:27:31.221099 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 20 09:27:31.221226 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 20 09:27:31.221340 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: nodename: dv-cinder-819082-2-iscsi Dec 20 09:27:31.221480 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: machine: x86_64 Dec 20 09:27:31.221585 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: clock source: unix Dec 20 09:27:31.221702 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: pcre jit disabled Dec 20 09:27:31.221832 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: detected number of CPU cores: 4 Dec 20 09:27:31.221968 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: current working directory: / Dec 20 09:27:31.221968 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: detected binary path: /usr/bin/uwsgi-core Dec 20 09:27:31.221968 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: your processes number limit is 47680 Dec 20 09:27:31.221968 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: your memory page size is 4096 bytes Dec 20 09:27:31.221968 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: detected max file descriptor number: 2048 Dec 20 09:27:31.221968 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: lock engine: pthread robust mutexes Dec 20 09:27:31.222384 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: thunder lock: enabled Dec 20 09:27:31.222384 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 20 09:27:31.222384 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 20 09:27:31.268146 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: Python main interpreter initialized at 0x5582027df9c0 Dec 20 09:27:31.268146 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: python threads support enabled Dec 20 09:27:31.268146 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: your server socket listen backlog is limited to 100 connections Dec 20 09:27:31.268146 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: your mercy for graceful operations on workers is 90 seconds Dec 20 09:27:31.268580 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: mapped 403077 bytes (393 KB) for 2 cores Dec 20 09:27:31.268580 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: *** Operational MODE: preforking *** Dec 20 09:27:31.268851 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: *** uWSGI is running in multiple interpreter mode *** Dec 20 09:27:31.268851 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: spawned uWSGI master process (pid: 116656) Dec 20 09:27:31.269056 dv-cinder-819082-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 20 09:27:31.270349 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: spawned uWSGI worker 1 (pid: 116674, cores: 1) Dec 20 09:27:31.270349 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: spawned uWSGI worker 2 (pid: 116675, cores: 1) Dec 20 09:27:31.270349 dv-cinder-819082-2-iscsi devstack@n-api.service[116656]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 20 09:27:33.173091 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 20 09:27:33.173091 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: from cryptography.utils import int_from_bytes Dec 20 09:27:33.173763 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 20 09:27:33.173763 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: from cryptography.utils import int_from_bytes Dec 20 09:27:33.177569 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 20 09:27:33.177569 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: from cryptography.utils import int_from_bytes Dec 20 09:27:33.178081 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 20 09:27:33.178081 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: from cryptography.utils import int_from_bytes Dec 20 09:27:35.607540 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 20 09:27:35.608161 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 20 09:27:35.608431 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 20 09:27:35.608679 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 20 09:27:35.608939 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 20 09:27:35.609337 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.609661 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.609986 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.610308 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.610641 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.610956 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.611281 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.611605 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.611967 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.612233 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.612560 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.612892 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819082-2-iscsi {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.613218 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.613530 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 20 09:27:35.613919 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.613996 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 20 09:27:35.614073 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.614162 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.614351 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 20 09:27:35.614458 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.614759 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.614872 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 20 09:27:35.615038 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 20 09:27:35.615143 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.615448 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.615556 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.616991 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.617135 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.617227 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.617310 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.617381 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.617457 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.617533 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.617634 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.617713 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.617789 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.617865 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.617939 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.618021 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.618099 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.618170 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.618249 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.618326 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.618651 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.618771 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.618862 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.618963 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819082-2-iscsi {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.619200 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819082-2-iscsi {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.619455 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.619724 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.619983 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.620205 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.620435 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.620655 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.620875 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.621100 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.621322 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.621542 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.621752 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.621970 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.622177 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.622177 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.622614 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.622890 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.623144 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.623372 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.623605 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.623937 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.624147 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.624326 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.624507 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.624702 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.624957 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.625138 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.625286 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.625441 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.625608 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.625801 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.625965 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.626122 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.626279 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.626431 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.626577 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.626732 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.626732 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.627031 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819082-2-iscsi {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.627252 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.627403 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.627554 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.627746 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.627899 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.628044 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.628186 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.628341 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.628509 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.628663 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.628813 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.630250 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.630421 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.630581 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.630754 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.630909 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.631065 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.631223 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.631383 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.631542 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.631721 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.631721 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.632015 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.632169 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.632323 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.632480 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.632644 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.632789 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.632943 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.633097 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.633244 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.633401 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.633558 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.633710 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.633861 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.634007 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.634151 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.634305 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.634459 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.634459 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.634754 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.634906 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.635068 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.635215 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.635368 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.635521 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.635743 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.635906 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.636072 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.636218 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.636375 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.636541 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.636689 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.636833 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.637005 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.637159 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.637423 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.637617 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.637774 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.637934 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.638085 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.638230 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.638382 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.638539 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.638697 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.638868 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.639023 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.639222 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.640204 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.640576 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.640740 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.640903 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.641050 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.641206 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.641360 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.641513 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.641689 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.641689 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.641981 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.642127 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.642271 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.642422 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.642584 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.642738 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.642893 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.643039 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.643190 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.643343 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.643503 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.643680 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.643832 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.643978 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.644135 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.644298 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.644444 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.644588 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.644741 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.644886 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.645031 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.645187 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.645333 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.645484 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.645638 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.645792 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.645949 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.646104 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.646257 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.646409 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.646561 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.646705 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.646867 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.647019 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.647173 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.647326 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.647487 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.647682 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.647849 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.648079 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.648355 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.648522 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.648650 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.648778 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.648902 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.649015 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.649134 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.649261 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.649383 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.649502 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.649622 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.650921 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.651186 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.651313 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.651426 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.651546 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.651686 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.651805 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.652080 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.652323 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.652484 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.652631 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.652798 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.652944 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.653105 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.653257 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.653402 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.653545 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.653697 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.653842 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.653999 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.654146 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.654289 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.654442 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.654587 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.654740 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.654894 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.655045 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.655191 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.655334 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.655487 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.655639 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.655909 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.656063 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.656217 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.656371 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.656515 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.656668 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.656872 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.657036 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.657190 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.657393 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.657393 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.657714 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.657871 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.658017 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.658174 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.658328 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.658482 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.658639 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.658794 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.658953 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.658953 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.659283 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.659440 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.659584 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.659763 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.660787 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.660887 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.660968 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.661039 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.661107 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.661175 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.661252 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.661323 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.661396 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.661472 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.661540 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.661614 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.661698 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.661767 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.661841 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.661916 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.661985 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.662061 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.662136 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.662211 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.662285 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.662353 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.662419 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.662497 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.662572 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.662640 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.662713 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.662782 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 09:27:35.662848 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.662924 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.662993 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.663067 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.663135 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.663135 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.663284 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.663360 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.663360 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.663491 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.663565 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.663646 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.663780 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.663860 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.663939 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.664008 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.664091 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.664167 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.664242 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.664334 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.664423 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.664514 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.664603 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.664693 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.664775 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.664864 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.664946 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.665033 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.665115 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.665195 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.665282 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.665380 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.665471 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.665553 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.665635 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.665715 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.665795 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.665948 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.666521 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.666613 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.666704 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.666787 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.666875 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.666965 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.667053 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.667136 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.667224 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.667306 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.667409 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.667550 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.667741 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.667816 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.667884 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.675891 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.676118 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.676294 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.676465 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.676631 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.676798 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.676954 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.677118 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.677280 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.677484 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.677650 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.677803 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.678026 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.678189 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.678355 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.678507 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.678658 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.678809 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.678969 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.679120 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.679272 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.679438 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.679590 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.679775 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.679775 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.680174 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.680353 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.680676 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.680916 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.681330 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.681703 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.682050 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.682217 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.682396 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.682675 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.682863 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.682863 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.683281 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.683281 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.683597 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.683775 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.683942 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.683942 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.684241 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.684241 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.684548 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.684707 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.684874 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.684874 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.685170 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.685322 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.685473 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.685647 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.685814 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.686154 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.686323 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.686323 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.686626 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.686788 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.686949 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.687109 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.687273 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.687425 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.687577 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.687773 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.687953 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.688114 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.688274 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.688435 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.688595 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.688758 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.688912 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.689063 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.689215 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.689374 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.689534 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.689701 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.690398 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.690632 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.690965 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.691205 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.691379 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.691534 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.691798 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.691973 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.691973 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.692489 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.692656 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.692656 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.692972 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.693138 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.693290 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.693450 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.693616 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.693769 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.693921 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.694073 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.694225 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.694384 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.694550 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.695453 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.695629 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.695829 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.696013 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.696341 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.696499 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.696659 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.696812 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.696963 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.697115 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.697306 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.697459 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.697618 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.697771 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.697930 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.698090 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.698266 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.698419 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.698571 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.698721 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.698878 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.699031 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.699195 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.699357 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.699517 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.699696 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.699854 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.700018 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.700171 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.700342 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.700589 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.700747 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.701058 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.701245 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.701469 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.701634 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.701802 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.701802 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.702187 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.702548 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.702710 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.702875 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.703027 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.703185 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.703344 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.703506 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.703677 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.703837 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.704001 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.704154 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.704306 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.704472 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.704689 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.704844 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.705007 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.705168 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.705335 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.705495 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.705648 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.705805 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.705957 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.706107 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.706425 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.706587 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.706742 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.706972 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.707129 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.707300 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.707468 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.707630 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.707825 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.707979 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.708131 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.708283 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.708444 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.708675 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.708844 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.708998 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.709150 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.709311 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.709485 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.709646 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.709801 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.709961 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.710114 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.710286 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.710439 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.710616 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.710846 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.711004 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.711321 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.711506 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.711742 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.711921 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.712170 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.712329 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.712329 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.713432 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.713669 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.713823 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.713976 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.714135 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.714301 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.714453 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.714613 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.714766 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.714938 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.715091 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.715338 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.715506 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.715675 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.715844 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.715999 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.716151 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.716313 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.716619 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.716779 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.716942 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.717116 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.717268 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.717430 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.717583 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.717741 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.717902 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.718054 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.718215 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.718381 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.718541 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.719590 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.719866 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.720115 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.720281 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.720441 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.720595 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.720755 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.721023 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.721507 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.721733 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.721973 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.722150 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.722392 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.722564 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.722959 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.723143 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.723297 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.723458 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.723620 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.723809 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.723963 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.724115 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.724266 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.724419 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.724579 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.724741 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.724903 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.725056 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.725219 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.725378 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.725545 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.725706 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.725866 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.726018 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.726168 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.726399 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.726736 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.726897 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.727057 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.727209 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.727209 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.727522 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.727747 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.727917 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.728070 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.728221 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.729031 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.729356 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.729532 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.729697 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.729853 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.730004 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.730163 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.730340 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.730735 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.730899 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.731163 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.731323 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.731594 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.732035 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.732212 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.732387 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.732626 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.732777 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.732976 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.733288 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.733450 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.733592 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.733810 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.733956 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.734106 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.734257 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.734409 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.734558 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.734708 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.734851 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.735006 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.735150 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.735291 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.735450 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.735601 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.735762 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.735922 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.736064 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.736213 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.736367 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.736508 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.736671 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.736890 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.737040 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.737183 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.737344 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.737497 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.737667 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.737667 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.737947 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.738099 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.738318 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.738472 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.738620 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.738760 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.738976 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.739129 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.739306 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.739470 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.739613 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.739802 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.739952 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.740104 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.740247 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.740387 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.740527 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.740670 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.740819 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.740973 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.741141 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.741285 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.741384 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.741470 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.741561 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.741670 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.741757 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.741850 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.741936 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.742027 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.742280 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.742373 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.742466 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.742551 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.742650 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.742742 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.742837 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.742930 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.743015 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.743112 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.743205 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.743466 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.743574 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.743686 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.743847 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.743944 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.744051 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.744147 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.744232 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.744323 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.744415 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.744513 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.744598 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.744681 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.744681 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.744833 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.744914 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.745082 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.745186 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.745272 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.745357 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.745440 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.745440 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.745607 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.745694 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.745776 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.745776 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.745927 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.746018 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.746103 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.746193 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.746278 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.746360 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.746508 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.746655 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.746789 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.746940 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.747038 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.747124 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.747207 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.747310 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.747397 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.747489 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.747574 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.747690 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.747798 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.747949 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.748041 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.748124 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.748215 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.748300 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.748393 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.748479 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.748563 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.748657 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.748742 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.748825 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.748918 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.749009 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.749094 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.749184 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.749275 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.749360 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.749469 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.749557 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.749648 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.749733 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.749822 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.749907 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.750002 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.750093 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.750178 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.750261 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.750352 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.750445 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.750538 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.750622 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.750705 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.750795 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.750880 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.750972 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.751056 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.751395 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.751498 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.751591 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.751694 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.751797 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.751884 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.751974 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.752117 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.752244 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.752330 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.752416 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.752508 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.752594 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.752686 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.752778 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.752876 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.752968 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.753054 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.753137 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.753227 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.753312 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.753624 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.753760 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.753874 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.753987 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.754107 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.754202 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.754559 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.754652 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.754736 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.754824 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.754910 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.754994 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.755086 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.755171 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.755255 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.755337 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.755433 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.755527 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.755629 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.755805 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.755895 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.755979 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.756070 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.756176 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.756270 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.756355 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.756439 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.756529 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.756621 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.756719 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.756805 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.756889 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.757022 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.757154 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.757251 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.757350 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.757436 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.757519 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.757640 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.757720 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.757799 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.757892 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.757977 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.758071 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.758156 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.758239 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.758419 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.758536 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.758648 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.758768 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.758890 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.759012 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.759137 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.759260 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.759379 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.759493 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.759617 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.759791 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.759917 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.760081 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.760204 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.760325 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.760440 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.760552 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.760674 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.760798 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.760921 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.761039 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.761153 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.761275 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.761414 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.761606 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.761723 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.761844 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.761958 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.762081 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.762205 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.762330 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.762456 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.762578 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.762741 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.762941 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.763069 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.763183 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.763304 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.763417 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.763549 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.763910 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.764033 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.764153 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.764267 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.764378 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.764504 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.764624 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.764746 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.764867 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.764981 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.765106 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.765194 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.765265 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.765334 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.765402 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.765477 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.765547 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.765628 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.765720 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.765812 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.765905 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.765997 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.766088 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.766187 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.766272 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.766355 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.766487 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.766571 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.766659 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.766744 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.766828 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.766911 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.766992 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.767120 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.767273 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.767401 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.767488 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.767560 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.767643 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.767812 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.767812 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.767986 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.768071 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.768155 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.768155 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.768344 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.768430 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.768509 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.768587 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.768672 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.768749 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.768854 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.768948 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.769040 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.769130 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.769214 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.769297 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.769393 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.769518 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.769603 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.769674 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.769756 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.769833 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.769916 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.770007 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.770099 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.770183 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.770266 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.770348 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.770474 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.770647 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.770743 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.770828 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.770920 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.771055 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.771222 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.771376 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.771511 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.771617 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.771749 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.771749 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.771958 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.772044 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.772135 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.772220 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.772304 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.772397 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.772489 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.772489 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.772826 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.772922 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.773008 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.773101 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.773194 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.773286 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.773378 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.773469 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.773562 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.773648 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.773732 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.773830 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.774090 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.774262 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.774365 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.774452 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.774543 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.774636 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.774733 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.774815 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.774887 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.774955 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.774955 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.775079 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.775079 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.775218 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.775841 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.775917 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.775917 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.776066 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.776066 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.776209 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.776209 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.776333 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.776333 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.776478 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.776478 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.776621 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.776692 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.776760 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.776842 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.776986 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.777073 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.777157 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.777227 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.777295 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.777436 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.777582 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.777686 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.777784 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.777951 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.778039 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.778123 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.778220 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.778313 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.778404 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.778488 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.778571 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.778734 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.778848 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.779055 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.779158 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.779376 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.779478 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.779726 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.779838 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.780039 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.780148 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.780348 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.780458 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.780664 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.780768 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.780973 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.781068 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.781283 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.781383 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.781733 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.781855 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.781951 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.782086 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.782256 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.782395 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.782589 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.782694 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.782919 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.783017 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.783251 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.783363 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.783584 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.783695 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.783942 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.784051 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.784257 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.784382 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.784564 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.784661 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.784873 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.785009 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.785183 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.785318 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.785494 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.785588 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.785823 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.785917 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.786149 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.786254 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.786475 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.786579 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.786802 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.786898 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.787134 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.787229 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.787450 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.787548 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.787803 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.787905 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.788127 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.788230 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.788444 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.788548 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.788767 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.788860 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.789086 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.789180 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.789403 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.789503 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.789716 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.789810 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.790032 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.790125 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.790342 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.790437 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.790656 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.790770 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.791498 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.791605 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.791863 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.792015 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.792181 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.792458 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.792558 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.792792 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.792924 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.793114 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.793236 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.793424 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.793547 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.793746 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.793866 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.794063 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.794196 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.794415 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.794555 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.794679 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.794792 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.794982 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.795114 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.796537 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.796659 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.796783 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.796900 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.797021 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.797128 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.797217 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.797302 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.797385 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.797471 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.797471 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.797471 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.797789 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.797970 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.798068 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.798308 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.798412 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.798640 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.798745 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.798966 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.799066 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.799294 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.799402 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.799617 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.799730 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.800001 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.800133 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.800318 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.800450 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.800643 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.800765 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.800967 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.801097 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.801291 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.801394 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.801610 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.801881 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.801978 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.802218 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.802327 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.802537 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.802631 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.802855 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.802951 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.803172 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.803285 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.803489 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.803592 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.803835 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.803930 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.804158 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.804255 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.804483 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.804610 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.804806 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.804921 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.805121 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.805215 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.805440 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.805557 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.805763 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.805860 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.806093 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.806286 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.806438 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.806634 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.806780 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.807022 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.807132 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.807303 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.807405 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.807632 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.807811 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.807982 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.808089 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.808305 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.808402 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.808637 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.808747 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.808949 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.809043 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.809260 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.809383 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.809578 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.809715 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.809896 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.810003 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.810205 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.810302 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.810532 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.810642 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.810847 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.810939 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.811155 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.811247 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.811470 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.811577 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.811815 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.811925 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.812137 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.812360 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.812538 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.812717 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.812813 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.813040 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.813142 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.813373 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.813482 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.813711 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.813806 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.814034 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.814130 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.814348 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.814559 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.814720 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.814883 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.814986 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.815223 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.815336 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.815556 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.815704 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.815913 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.816012 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.816222 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.816331 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.816534 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.816629 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.816863 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.816982 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.817283 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.817394 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.817471 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.817541 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.817783 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.817885 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.818095 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.818204 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.818403 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.818512 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.818721 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.818825 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.819032 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.819128 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.819342 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.819437 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.819714 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.819858 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.820037 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.820133 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.820283 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.820524 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.820619 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.820886 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.820998 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.821201 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.821303 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.821509 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.821613 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.821825 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.821936 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.822658 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.822817 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.822991 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.823116 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.823300 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.823615 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.823951 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.824349 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.824663 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.825073 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.825181 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.825417 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.825621 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.825752 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.826096 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.826198 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.826433 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.826755 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.827100 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.827232 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.827436 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.827597 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.827863 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.828241 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.828875 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.829127 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.829213 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.829794 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.830229 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.830377 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.830650 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.830988 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.831343 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.831788 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.832025 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.832352 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.832685 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.833011 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.833335 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.833657 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.833976 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.834305 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.834625 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.834952 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.835269 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.835603 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.835948 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.836271 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.836589 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.836931 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.837202 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.837367 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.837655 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.838215 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.838457 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.838626 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.838740 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.838817 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.838896 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.838968 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.839037 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.839106 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.839356 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.839522 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.839522 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.839722 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.839866 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.839949 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.840199 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.840445 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.841097 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.841354 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.841499 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.841688 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.841865 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.842049 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.842219 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.842403 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.842569 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.842723 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.842925 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.843030 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.843345 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.843487 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.843697 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.843840 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.844029 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.844178 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.844348 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.844512 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.844662 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.844858 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.844999 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.845241 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.845397 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.845521 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.845650 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.846378 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.846498 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.846498 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.846726 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.846850 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.846973 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.847089 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.847235 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.847447 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.847577 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.847934 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.848068 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.848214 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.848595 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.848727 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.848852 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.848974 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.849089 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.849211 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.849328 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.849448 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.849574 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.849782 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.849915 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.850030 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.850030 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.850259 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.850384 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.850499 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.850667 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.850790 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.850982 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.851164 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.851311 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.851544 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.851739 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.851879 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.852034 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.852164 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.852355 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.852479 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.852742 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.852874 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.853027 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.853149 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.853475 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.853606 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.853745 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.853909 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.854040 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.854169 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.854284 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.854405 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.854713 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.854846 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.854976 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.855053 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.855229 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.855328 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.855570 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.855704 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.855910 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.856006 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.856226 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.856331 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.856541 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.856652 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.856862 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.856958 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.857200 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.857311 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.857542 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.857637 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.857866 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.857973 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.858197 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.858314 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.858513 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.858633 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.858839 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.858943 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.859153 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.859247 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.859476 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.859570 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.859829 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.859940 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.860157 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.860254 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.860476 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.860570 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.860817 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.860922 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.861137 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.861234 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.861460 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.861555 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.861823 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.861971 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.862125 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.862250 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.862447 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.862546 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.862767 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.862865 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.863105 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.863206 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.863439 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.863533 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.863781 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.863918 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.864111 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.864205 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.864436 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.864543 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.864766 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.864861 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.865093 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.865189 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.865414 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.865518 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.865761 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.865855 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.866081 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.866181 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.866409 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.866515 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.866730 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.866834 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.867052 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.867147 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.867378 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.867484 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.867726 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.867835 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.868068 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.868211 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.868456 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 20 09:27:35.868595 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.868781 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.869080 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.869437 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.873247 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.873247 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.873247 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.873247 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.873247 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.873247 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 09:27:35.873247 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 20 09:27:35.893788 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_db.sqlalchemy.engines [None req-dc490564-b56d-4d9f-9746-96cf2aa73252 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 09:27:35.894845 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_db.sqlalchemy.engines [None req-f07f2add-5564-4563-945e-299a094c32d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 09:27:35.960342 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.context [None req-dc490564-b56d-4d9f-9746-96cf2aa73252 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6e0e0af-77e8-4802-8159-a0a3ab8beb6c(cell1) {{(pid=116675) load_cells /opt/stack/nova/nova/context.py:464}} Dec 20 09:27:35.965172 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-dc490564-b56d-4d9f-9746-96cf2aa73252 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:27:35.966784 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-dc490564-b56d-4d9f-9746-96cf2aa73252 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:27:35.967741 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-dc490564-b56d-4d9f-9746-96cf2aa73252 None None] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:27:35.969586 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-dc490564-b56d-4d9f-9746-96cf2aa73252 None None] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:27:35.970312 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.context [None req-f07f2add-5564-4563-945e-299a094c32d5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6e0e0af-77e8-4802-8159-a0a3ab8beb6c(cell1) {{(pid=116674) load_cells /opt/stack/nova/nova/context.py:464}} Dec 20 09:27:35.974877 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f07f2add-5564-4563-945e-299a094c32d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:27:35.976537 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f07f2add-5564-4563-945e-299a094c32d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:27:35.977645 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f07f2add-5564-4563-945e-299a094c32d5 None None] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:27:35.981318 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f07f2add-5564-4563-945e-299a094c32d5 None None] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:27:35.982196 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_db.sqlalchemy.engines [None req-dc490564-b56d-4d9f-9746-96cf2aa73252 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 09:27:35.985731 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_db.sqlalchemy.engines [None req-dc490564-b56d-4d9f-9746-96cf2aa73252 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 09:27:35.992372 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_db.sqlalchemy.engines [None req-f07f2add-5564-4563-945e-299a094c32d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 09:27:35.994094 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_db.sqlalchemy.engines [None req-f07f2add-5564-4563-945e-299a094c32d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 09:27:36.169331 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_db.sqlalchemy.engines [None req-f07f2add-5564-4563-945e-299a094c32d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 09:27:36.187112 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_db.sqlalchemy.engines [None req-dc490564-b56d-4d9f-9746-96cf2aa73252 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 09:27:36.504711 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: WARNING keystonemiddleware.auth_token [None req-f07f2add-5564-4563-945e-299a094c32d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 20 09:27:36.511391 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: WARNING keystonemiddleware.auth_token [None req-f07f2add-5564-4563-945e-299a094c32d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 20 09:27:36.535054 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: WARNING keystonemiddleware.auth_token [None req-dc490564-b56d-4d9f-9746-96cf2aa73252 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 20 09:27:36.542972 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: WARNING keystonemiddleware.auth_token [None req-dc490564-b56d-4d9f-9746-96cf2aa73252 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 20 09:27:36.861536 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: WARNING keystonemiddleware.auth_token [None req-f07f2add-5564-4563-945e-299a094c32d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 20 09:27:36.866796 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: WARNING keystonemiddleware.auth_token [None req-f07f2add-5564-4563-945e-299a094c32d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 20 09:27:36.872233 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5582027df9c0 pid: 116674 (default app) Dec 20 09:27:36.891175 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: WARNING keystonemiddleware.auth_token [None req-dc490564-b56d-4d9f-9746-96cf2aa73252 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 20 09:27:36.896410 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: WARNING keystonemiddleware.auth_token [None req-dc490564-b56d-4d9f-9746-96cf2aa73252 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 20 09:27:36.902316 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5582027df9c0 pid: 116675 (default app) Dec 20 09:28:13.268258 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-48eaa244-246b-437d-8c9c-c69f7e1a4711 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Action: 'create', calling method: .version_select at 0x7f91509a9ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1409591923"}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:28:15.053815 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-47055ec7-cd0b-4b54-8f34-82a36a807371 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-249515117", "imageRef": "6f828f0b-c445-46a5-9960-492746785ef3", "flavorRef": "452", "networks": [{"uuid": "592e6d9b-f04d-4c1d-9f59-c10ab1eca584"}]}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:28:15.371478 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-48eaa244-246b-437d-8c9c-c69f7e1a4711 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.655218 Dec 20 09:28:15.380128 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 1/1] 10.222.0.62 () {60 vars in 1154 bytes} [Mon Dec 20 09:28:11 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3668 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 20 09:28:15.393987 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-44fa0c11-3536-4fdc-86e0-773bb4516fa8 tempest-VolumesTestJSON-1530434249 tempest-VolumesTestJSON-1530434249-project] Calling method '.version_select at 0x7f9150889a60>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:15.545003 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-44fa0c11-3536-4fdc-86e0-773bb4516fa8 tempest-VolumesTestJSON-1530434249 tempest-VolumesTestJSON-1530434249-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/5eb38fb2-88b4-4b27-8ffe-007eae152f4d" status: 200 len: 350 microversion: 2.1 time: 0.162621 Dec 20 09:28:15.545574 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 2/2] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 20 09:28:15 2021] GET /compute/v2.1/os-volumes/5eb38fb2-88b4-4b27-8ffe-007eae152f4d => generated 350 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:28:15.557370 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b0556220-5d25-4cd5-be0e-705ab48b0d62 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Calling method '.version_select at 0x7f9150889ee0>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:15.661050 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b0556220-5d25-4cd5-be0e-705ab48b0d62 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/25dfc13e-103c-40e7-a660-b4e74162765a" status: 200 len: 345 microversion: 2.1 time: 0.108016 Dec 20 09:28:15.666870 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 3/3] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 20 09:28:15 2021] GET /compute/v2.1/os-volumes/25dfc13e-103c-40e7-a660-b4e74162765a => generated 345 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:28:15.800328 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.network.neutron [None req-47055ec7-cd0b-4b54-8f34-82a36a807371 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] validate_networks() for [('592e6d9b-f04d-4c1d-9f59-c10ab1eca584', None, None, None, None, None)] {{(pid=116675) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 09:28:16.673800 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4862b48b-3147-4d48-a0e9-0cb0356a4c7c tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Calling method '.version_select at 0x7f915089d430>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:16.740296 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-4862b48b-3147-4d48-a0e9-0cb0356a4c7c tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/25dfc13e-103c-40e7-a660-b4e74162765a" status: 200 len: 346 microversion: 2.1 time: 0.069831 Dec 20 09:28:16.741161 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 4/4] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 20 09:28:16 2021] GET /compute/v2.1/os-volumes/25dfc13e-103c-40e7-a660-b4e74162765a => generated 346 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:28:16.753024 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-23dd3dde-fe56-4e6b-b678-5811ab247284 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Action: 'create', calling method: .version_select at 0x7f915089ddc0>, body: {"snapshot": {"volume_id": "25dfc13e-103c-40e7-a660-b4e74162765a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-893720160"}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:28:17.382459 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-23dd3dde-fe56-4e6b-b678-5811ab247284 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] 10.222.0.62 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.632812 Dec 20 09:28:17.383045 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 5/5] 10.222.0.62 () {60 vars in 1161 bytes} [Mon Dec 20 09:28:16 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:28:17.395513 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-93c5fa41-174e-4b33-8ce2-58ce7d1a244d tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Calling method '.version_select at 0x7f915089dd30>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:17.517651 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-93c5fa41-174e-4b33-8ce2-58ce7d1a244d tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa" status: 200 len: 286 microversion: 2.1 time: 0.128372 Dec 20 09:28:17.518435 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 6/6] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Dec 20 09:28:17 2021] GET /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa => generated 286 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:28:17.529543 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8469f613-fc9d-4315-8389-16810d724e7b tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Calling method '.version_select at 0x7f915089d550>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:17.599174 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8469f613-fc9d-4315-8389-16810d724e7b tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.071930 Dec 20 09:28:17.602130 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 7/7] 10.222.0.62 () {58 vars in 1139 bytes} [Mon Dec 20 09:28:17 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:28:17.605649 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c3abb2e1-4c73-4234-98a6-a80cc2fb8a14 tempest-VolumesTestJSON-1530434249 tempest-VolumesTestJSON-1530434249-project] Calling method '.version_select at 0x7f91508274c0>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:17.688639 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c3abb2e1-4c73-4234-98a6-a80cc2fb8a14 tempest-VolumesTestJSON-1530434249 tempest-VolumesTestJSON-1530434249-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/cd13d1b0-31e4-4aab-ab89-c2b5a33dc40b" status: 200 len: 350 microversion: 2.1 time: 0.087826 Dec 20 09:28:17.689844 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 8/8] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 20 09:28:17 2021] GET /compute/v2.1/os-volumes/cd13d1b0-31e4-4aab-ab89-c2b5a33dc40b => generated 350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:28:17.695862 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-366d1b2a-dfcb-4b90-b094-00249e6ec52a tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Calling method '.version_select at 0x7f91512075e0>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:17.728044 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-366d1b2a-dfcb-4b90-b094-00249e6ec52a tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa" status: 200 len: 286 microversion: 2.1 time: 0.037033 Dec 20 09:28:17.728932 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 9/9] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Dec 20 09:28:17 2021] GET /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:28:18.096473 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-47055ec7-cd0b-4b54-8f34-82a36a807371 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Flavor limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 09:28:18.097089 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-47055ec7-cd0b-4b54-8f34-82a36a807371 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Image limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 09:28:18.097362 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-47055ec7-cd0b-4b54-8f34-82a36a807371 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Flavor pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 09:28:18.097776 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-47055ec7-cd0b-4b54-8f34-82a36a807371 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Image pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 09:28:18.098206 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-47055ec7-cd0b-4b54-8f34-82a36a807371 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 09:28:18.126724 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-47055ec7-cd0b-4b54-8f34-82a36a807371 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:18.127174 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-47055ec7-cd0b-4b54-8f34-82a36a807371 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:18.128272 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-47055ec7-cd0b-4b54-8f34-82a36a807371 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:18.128706 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-47055ec7-cd0b-4b54-8f34-82a36a807371 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:18.194566 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-47055ec7-cd0b-4b54-8f34-82a36a807371 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Getting quotas for project 80def36911934a13be751381aa024b36. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:28:18.210043 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-47055ec7-cd0b-4b54-8f34-82a36a807371 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Getting quotas for user a951df3654f0452d9bbf88a595fd18f4 and project 80def36911934a13be751381aa024b36. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:28:18.224527 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-47055ec7-cd0b-4b54-8f34-82a36a807371 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Going to run 1 instances... {{(pid=116675) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 09:28:18.229629 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-47055ec7-cd0b-4b54-8f34-82a36a807371 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f828f0b-c445-46a5-9960-492746785ef3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 09:28:18.408384 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-47055ec7-cd0b-4b54-8f34-82a36a807371 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.980246 Dec 20 09:28:18.420420 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a8ed9b7d-f47d-4c24-a804-63ea13017f5d tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:18.420772 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 1/10] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 20 09:28:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 3988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 09:28:18.422510 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a8ed9b7d-f47d-4c24-a804-63ea13017f5d tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:18.597404 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a8ed9b7d-f47d-4c24-a804-63ea13017f5d tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:18.634277 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a8ed9b7d-f47d-4c24-a804-63ea13017f5d tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1214 microversion: 2.1 time: 0.216046 Dec 20 09:28:18.646635 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 10/11] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:18 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1214 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:18.742390 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1a0558c1-3423-4b9f-a2da-278e6abea2a0 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Calling method '.version_select at 0x7f914ffb5790>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:18.850917 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1a0558c1-3423-4b9f-a2da-278e6abea2a0 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa" status: 200 len: 286 microversion: 2.1 time: 0.113669 Dec 20 09:28:18.851736 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 2/12] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Dec 20 09:28:18 2021] GET /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa => generated 286 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:28:19.651362 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8fea10db-7c01-4e7a-8449-a74fb3b38ce4 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:19.652770 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8fea10db-7c01-4e7a-8449-a74fb3b38ce4 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:19.772785 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8fea10db-7c01-4e7a-8449-a74fb3b38ce4 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:19.797367 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8fea10db-7c01-4e7a-8449-a74fb3b38ce4 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1214 microversion: 2.1 time: 0.150764 Dec 20 09:28:19.798159 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 3/13] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:19 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:19.880915 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-04ca9276-8d44-4932-b282-8c9c117e03e1 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Calling method '.version_select at 0x7f914f73caf0>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:19.902421 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-cab041ec-a868-46c0-bfc9-0b0dec0ed33f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'create', calling method: .version_select at 0x7f9150827940>, body: {"keypair": {"name": "tempest-keypair-1885543107"}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:28:19.938184 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-04ca9276-8d44-4932-b282-8c9c117e03e1 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa" status: 200 len: 286 microversion: 2.1 time: 0.078177 Dec 20 09:28:19.939018 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 4/14] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Dec 20 09:28:19 2021] GET /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:28:20.049386 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-cab041ec-a868-46c0-bfc9-0b0dec0ed33f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Getting quotas for project b2ad93eaa3c541839f4737919bf7dc8c. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:28:20.064484 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-cab041ec-a868-46c0-bfc9-0b0dec0ed33f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Getting quotas for user b25e3e674c0e4530b1760b2a9d769851 and project b2ad93eaa3c541839f4737919bf7dc8c. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:28:20.855091 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-efbc3354-2634-4396-b4c3-70535395a0e6 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:20.855091 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-efbc3354-2634-4396-b4c3-70535395a0e6 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:21.034793 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-cab041ec-a868-46c0-bfc9-0b0dec0ed33f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Getting quotas for project b2ad93eaa3c541839f4737919bf7dc8c. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:28:21.045795 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-cab041ec-a868-46c0-bfc9-0b0dec0ed33f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Getting quotas for user b25e3e674c0e4530b1760b2a9d769851 and project b2ad93eaa3c541839f4737919bf7dc8c. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:28:21.078094 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-cab041ec-a868-46c0-bfc9-0b0dec0ed33f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.452808 Dec 20 09:28:21.080601 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 11/15] 10.222.0.62 () {62 vars in 1198 bytes} [Mon Dec 20 09:28:19 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1456 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 20 09:28:21.090949 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-6782451a-0b54-4ca8-8b25-495753706244 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Calling method '.version_select at 0x7f915089d700>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:21.138652 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-6782451a-0b54-4ca8-8b25-495753706244 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa" status: 200 len: 286 microversion: 2.1 time: 0.056891 Dec 20 09:28:21.143053 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 12/16] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Dec 20 09:28:21 2021] GET /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:28:21.330955 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-efbc3354-2634-4396-b4c3-70535395a0e6 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:21.340375 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-efbc3354-2634-4396-b4c3-70535395a0e6 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1214 microversion: 2.1 time: 0.529525 Dec 20 09:28:21.341287 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 5/17] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:20 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1214 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:28:22.151860 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8f09630e-9fc1-4f46-b96e-aaa575ef4f0a tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Calling method '.version_select at 0x7f91507daee0>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:22.195817 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8f09630e-9fc1-4f46-b96e-aaa575ef4f0a tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa" status: 200 len: 286 microversion: 2.1 time: 0.048976 Dec 20 09:28:22.201330 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 13/18] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Dec 20 09:28:22 2021] GET /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:28:22.357984 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f12f0aab-e4d2-4b78-82de-d484e251f70d tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:22.359190 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f12f0aab-e4d2-4b78-82de-d484e251f70d tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:22.369269 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f12f0aab-e4d2-4b78-82de-d484e251f70d tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:22.373784 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f12f0aab-e4d2-4b78-82de-d484e251f70d tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:22.374965 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f12f0aab-e4d2-4b78-82de-d484e251f70d tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:22.375779 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f12f0aab-e4d2-4b78-82de-d484e251f70d tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:22.795329 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f12f0aab-e4d2-4b78-82de-d484e251f70d tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:22.815323 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f12f0aab-e4d2-4b78-82de-d484e251f70d tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1218 microversion: 2.1 time: 0.460974 Dec 20 09:28:22.817531 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 6/19] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:22 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1218 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:23.213681 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-16d77dbf-3ce6-46cc-ab31-784a5b800f5b tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Calling method '.version_select at 0x7f915089ddc0>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:23.247163 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-16d77dbf-3ce6-46cc-ab31-784a5b800f5b tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa" status: 200 len: 286 microversion: 2.1 time: 0.039493 Dec 20 09:28:23.248045 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 14/20] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Dec 20 09:28:23 2021] GET /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:28:23.343965 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-75c640e7-3c09-49a2-bf65-14f87917e129 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-483150140", "imageRef": "6f828f0b-c445-46a5-9960-492746785ef3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "529f9fc3-6bd7-48ce-bed2-f3eb5fa2397f"}]}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:28:23.405374 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.network.neutron [None req-75c640e7-3c09-49a2-bf65-14f87917e129 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] validate_networks() for [('529f9fc3-6bd7-48ce-bed2-f3eb5fa2397f', None, None, None, None, None)] {{(pid=116675) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 09:28:23.819462 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-75c640e7-3c09-49a2-bf65-14f87917e129 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Flavor limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 09:28:23.819930 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-75c640e7-3c09-49a2-bf65-14f87917e129 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Image limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 09:28:23.820417 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-75c640e7-3c09-49a2-bf65-14f87917e129 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Flavor pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 09:28:23.820831 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-75c640e7-3c09-49a2-bf65-14f87917e129 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Image pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 09:28:23.821845 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-75c640e7-3c09-49a2-bf65-14f87917e129 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 09:28:23.832637 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-75c640e7-3c09-49a2-bf65-14f87917e129 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:23.833187 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-75c640e7-3c09-49a2-bf65-14f87917e129 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:23.833706 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-898f7147-a1da-40a6-9c52-a72ffc1b0281 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:23.834160 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-75c640e7-3c09-49a2-bf65-14f87917e129 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:23.834320 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-898f7147-a1da-40a6-9c52-a72ffc1b0281 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:23.834717 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-75c640e7-3c09-49a2-bf65-14f87917e129 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:23.843129 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-898f7147-a1da-40a6-9c52-a72ffc1b0281 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:23.843784 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-898f7147-a1da-40a6-9c52-a72ffc1b0281 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:23.844733 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-898f7147-a1da-40a6-9c52-a72ffc1b0281 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:23.845501 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-898f7147-a1da-40a6-9c52-a72ffc1b0281 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:23.854801 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-75c640e7-3c09-49a2-bf65-14f87917e129 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Getting quotas for project 9a71a458922842fa8e71a3dbc317ab9b. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:28:23.858827 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-75c640e7-3c09-49a2-bf65-14f87917e129 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Getting quotas for user f01ea99da66c4fc488bf6db0e03a3dcb and project 9a71a458922842fa8e71a3dbc317ab9b. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:28:23.870325 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-75c640e7-3c09-49a2-bf65-14f87917e129 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Going to run 1 instances... {{(pid=116675) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 09:28:23.872552 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-75c640e7-3c09-49a2-bf65-14f87917e129 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f828f0b-c445-46a5-9960-492746785ef3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 09:28:24.018009 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-898f7147-a1da-40a6-9c52-a72ffc1b0281 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:24.030897 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-898f7147-a1da-40a6-9c52-a72ffc1b0281 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1218 microversion: 2.1 time: 0.200817 Dec 20 09:28:24.031493 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 15/21] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:23 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1218 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:24.258250 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-55310e77-f592-441d-9e5f-b4703a234e0e tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Calling method '.version_select at 0x7f914ff02820>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:24.289474 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-55310e77-f592-441d-9e5f-b4703a234e0e tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa" status: 200 len: 286 microversion: 2.1 time: 0.034683 Dec 20 09:28:24.290375 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 16/22] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Dec 20 09:28:24 2021] GET /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:28:24.491006 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-75c640e7-3c09-49a2-bf65-14f87917e129 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.259909 Dec 20 09:28:24.498633 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 7/23] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 20 09:28:23 2021] POST /compute/v2.1/servers => generated 383 bytes in 1269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 20 09:28:24.502980 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3e763ee1-f62c-4c7e-95b2-d7be383237ff tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:24.503751 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-3e763ee1-f62c-4c7e-95b2-d7be383237ff tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:24.635558 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3e763ee1-f62c-4c7e-95b2-d7be383237ff tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:24.644083 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3e763ee1-f62c-4c7e-95b2-d7be383237ff tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1221 microversion: 2.1 time: 0.143978 Dec 20 09:28:24.645937 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 17/24] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:24 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1221 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:24.901199 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c868d08d-bc82-4ef0-90fc-a7e5289c8644 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-225988621", "imageRef": "6f828f0b-c445-46a5-9960-492746785ef3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "529f9fc3-6bd7-48ce-bed2-f3eb5fa2397f"}]}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:28:24.953480 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.network.neutron [None req-c868d08d-bc82-4ef0-90fc-a7e5289c8644 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] validate_networks() for [('529f9fc3-6bd7-48ce-bed2-f3eb5fa2397f', None, None, None, None, None)] {{(pid=116675) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 09:28:25.047402 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f3407c2c-bf6d-4d44-b4f9-5a618adf0ebf tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:25.048098 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f3407c2c-bf6d-4d44-b4f9-5a618adf0ebf tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:25.056022 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f3407c2c-bf6d-4d44-b4f9-5a618adf0ebf tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:25.056475 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f3407c2c-bf6d-4d44-b4f9-5a618adf0ebf tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:25.057761 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f3407c2c-bf6d-4d44-b4f9-5a618adf0ebf tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:25.058352 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f3407c2c-bf6d-4d44-b4f9-5a618adf0ebf tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:25.146059 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f3407c2c-bf6d-4d44-b4f9-5a618adf0ebf tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:25.154730 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f3407c2c-bf6d-4d44-b4f9-5a618adf0ebf tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1266 microversion: 2.1 time: 0.110997 Dec 20 09:28:25.165827 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 18/25] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:25 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:28:25.165827 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-902e0b04-b424-4862-8d0c-a0c62e27291a tempest-VolumesTestJSON-1530434249 tempest-VolumesTestJSON-1530434249-project] Calling method '.version_select at 0x7f914fea9c10>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:25.245291 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-902e0b04-b424-4862-8d0c-a0c62e27291a tempest-VolumesTestJSON-1530434249 tempest-VolumesTestJSON-1530434249-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/d9600b7e-a482-490e-9d25-30b93f086422" status: 200 len: 350 microversion: 2.1 time: 0.088653 Dec 20 09:28:25.246627 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 19/26] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 20 09:28:25 2021] GET /compute/v2.1/os-volumes/d9600b7e-a482-490e-9d25-30b93f086422 => generated 350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:28:25.259940 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1b60f1b2-1da7-44a7-a9a3-c637b863a364 tempest-VolumesTestJSON-1530434249 tempest-VolumesTestJSON-1530434249-project] Calling method '.version_select at 0x7f914fec4ca0>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:25.460592 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1b60f1b2-1da7-44a7-a9a3-c637b863a364 tempest-VolumesTestJSON-1530434249 tempest-VolumesTestJSON-1530434249-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.206496 Dec 20 09:28:25.461168 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 20/27] 10.222.0.62 () {58 vars in 1133 bytes} [Mon Dec 20 09:28:25 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:28:25.465462 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e1fffdb3-4a33-4e0c-8a77-5a086bb55e07 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Calling method '.version_select at 0x7f914fec4ee0>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:25.524410 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e1fffdb3-4a33-4e0c-8a77-5a086bb55e07 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa" status: 200 len: 287 microversion: 2.1 time: 0.062114 Dec 20 09:28:25.525283 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 21/28] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Dec 20 09:28:25 2021] GET /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:28:25.537412 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d81df104-fdf4-4f1c-9085-1dcaf2f6fc01 tempest-VolumesTestJSON-1530434249 tempest-VolumesTestJSON-1530434249-project] Calling method '.version_select at 0x7f914fea9670>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:25.790266 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d81df104-fdf4-4f1c-9085-1dcaf2f6fc01 tempest-VolumesTestJSON-1530434249 tempest-VolumesTestJSON-1530434249-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.263674 Dec 20 09:28:25.790844 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 22/29] 10.222.0.62 () {58 vars in 1148 bytes} [Mon Dec 20 09:28:25 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:28:25.795369 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-14afd6ea-01f8-452a-a524-f5a3d5567693 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Calling method '.version_select at 0x7f915089dc10>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:25.999773 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-14afd6ea-01f8-452a-a524-f5a3d5567693 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] 10.222.0.62 "DELETE /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa" status: 202 len: 0 microversion: 2.1 time: 0.207580 Dec 20 09:28:26.000887 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 23/30] 10.222.0.62 () {58 vars in 1253 bytes} [Mon Dec 20 09:28:25 2021] DELETE /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:28:26.008128 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b5272327-8630-4aab-a3de-01800c9689e8 tempest-VolumesTestJSON-1530434249 tempest-VolumesTestJSON-1530434249-project] Calling method '.version_select at 0x7f914ff02a60>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:26.157590 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b5272327-8630-4aab-a3de-01800c9689e8 tempest-VolumesTestJSON-1530434249 tempest-VolumesTestJSON-1530434249-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.155410 Dec 20 09:28:26.159018 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 24/31] 10.222.0.62 () {58 vars in 1133 bytes} [Mon Dec 20 09:28:26 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:26.163582 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4a3f82f8-8bbf-41d8-8c65-24a2ad4a8813 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Calling method '.version_select at 0x7f914fec4940>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:26.193413 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-c868d08d-bc82-4ef0-90fc-a7e5289c8644 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Flavor limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 09:28:26.193892 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-c868d08d-bc82-4ef0-90fc-a7e5289c8644 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Image limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 09:28:26.194454 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-c868d08d-bc82-4ef0-90fc-a7e5289c8644 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Flavor pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 09:28:26.195224 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-c868d08d-bc82-4ef0-90fc-a7e5289c8644 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Image pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 09:28:26.196428 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-c868d08d-bc82-4ef0-90fc-a7e5289c8644 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 09:28:26.220159 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c868d08d-bc82-4ef0-90fc-a7e5289c8644 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:26.220621 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c868d08d-bc82-4ef0-90fc-a7e5289c8644 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:26.226714 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c868d08d-bc82-4ef0-90fc-a7e5289c8644 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:26.227716 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c868d08d-bc82-4ef0-90fc-a7e5289c8644 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:26.254218 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-4a3f82f8-8bbf-41d8-8c65-24a2ad4a8813 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa" status: 200 len: 286 microversion: 2.1 time: 0.093832 Dec 20 09:28:26.255205 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 25/32] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Dec 20 09:28:26 2021] GET /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:28:26.262515 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d39ac55a-d390-43c5-a631-0890ecca8868 tempest-VolumesTestJSON-1530434249 tempest-VolumesTestJSON-1530434249-project] Calling method '.version_select at 0x7f914fec4f70>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:26.332619 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-c868d08d-bc82-4ef0-90fc-a7e5289c8644 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Getting quotas for project 9a71a458922842fa8e71a3dbc317ab9b. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:28:26.349995 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-c868d08d-bc82-4ef0-90fc-a7e5289c8644 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Getting quotas for user f01ea99da66c4fc488bf6db0e03a3dcb and project 9a71a458922842fa8e71a3dbc317ab9b. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:28:26.382447 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c868d08d-bc82-4ef0-90fc-a7e5289c8644 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Going to run 1 instances... {{(pid=116675) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 09:28:26.392821 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c868d08d-bc82-4ef0-90fc-a7e5289c8644 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f828f0b-c445-46a5-9960-492746785ef3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 09:28:26.601264 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c868d08d-bc82-4ef0-90fc-a7e5289c8644 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.705950 Dec 20 09:28:26.605085 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 8/33] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 20 09:28:24 2021] POST /compute/v2.1/servers => generated 383 bytes in 1709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 09:28:26.614465 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-de436484-af4c-433d-bb73-d416431b0f39 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:26.615414 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-de436484-af4c-433d-bb73-d416431b0f39 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:26.640749 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-de436484-af4c-433d-bb73-d416431b0f39 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:26.641442 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-de436484-af4c-433d-bb73-d416431b0f39 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:26.642514 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-de436484-af4c-433d-bb73-d416431b0f39 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:26.643118 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-de436484-af4c-433d-bb73-d416431b0f39 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:26.689845 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d39ac55a-d390-43c5-a631-0890ecca8868 tempest-VolumesTestJSON-1530434249 tempest-VolumesTestJSON-1530434249-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.433428 Dec 20 09:28:26.690894 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 26/34] 10.222.0.62 () {58 vars in 1166 bytes} [Mon Dec 20 09:28:26 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:28:26.697424 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-28d052ea-9ff4-41d4-b721-614de3bd9789 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:26.697424 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-28d052ea-9ff4-41d4-b721-614de3bd9789 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:26.756586 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-28d052ea-9ff4-41d4-b721-614de3bd9789 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:26.765706 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-28d052ea-9ff4-41d4-b721-614de3bd9789 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1221 microversion: 2.1 time: 0.073386 Dec 20 09:28:26.766825 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 27/35] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:26 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1221 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:26.772943 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b5e9d5d5-458a-4f65-978e-6fcdabad8948 tempest-VolumesTestJSON-1530434249 tempest-VolumesTestJSON-1530434249-project] Calling method '.version_select at 0x7f914feb8550>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:26.823304 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-de436484-af4c-433d-bb73-d416431b0f39 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:26.846108 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-de436484-af4c-433d-bb73-d416431b0f39 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1272 microversion: 2.1 time: 0.229489 Dec 20 09:28:26.846108 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 9/36] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:26 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1272 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:26.958918 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b5e9d5d5-458a-4f65-978e-6fcdabad8948 tempest-VolumesTestJSON-1530434249 tempest-VolumesTestJSON-1530434249-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.188157 Dec 20 09:28:26.958918 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 28/37] 10.222.0.62 () {58 vars in 1169 bytes} [Mon Dec 20 09:28:26 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:28:26.970689 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c6b7a004-a0c4-48bb-96ba-0b0a5b597b0e tempest-VolumesTestJSON-1530434249 tempest-VolumesTestJSON-1530434249-project] Calling method '.version_select at 0x7f914f68a9d0>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:27.142371 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c6b7a004-a0c4-48bb-96ba-0b0a5b597b0e tempest-VolumesTestJSON-1530434249 tempest-VolumesTestJSON-1530434249-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.175322 Dec 20 09:28:27.142941 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 10/38] 10.222.0.62 () {58 vars in 1154 bytes} [Mon Dec 20 09:28:26 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:27.156890 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-09a7f56e-e5da-4348-8393-d792a1a3fc0e tempest-VolumesTestJSON-1530434249 tempest-VolumesTestJSON-1530434249-project] Calling method '.version_select at 0x7f914fec5430>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:27.268539 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0a7ad6eb-4fd5-43ea-8d40-6cf846c09b9d tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Calling method '.version_select at 0x7f914f625f70>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:27.332910 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-09a7f56e-e5da-4348-8393-d792a1a3fc0e tempest-VolumesTestJSON-1530434249 tempest-VolumesTestJSON-1530434249-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.180822 Dec 20 09:28:27.337198 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 29/39] 10.222.0.62 () {58 vars in 1187 bytes} [Mon Dec 20 09:28:27 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:28:27.353445 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3569c896-2c4e-4a2e-a758-394fa54b0bbd tempest-VolumesTestJSON-1530434249 tempest-VolumesTestJSON-1530434249-project] Calling method '.version_select at 0x7f914fec5d30>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:27.363037 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-0a7ad6eb-4fd5-43ea-8d40-6cf846c09b9d tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] HTTP exception thrown: Snapshot 572a1c8e-8196-4578-b3bf-bfd5aba77caa could not be found. Dec 20 09:28:27.363849 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0a7ad6eb-4fd5-43ea-8d40-6cf846c09b9d tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Returning 404 to user: Snapshot 572a1c8e-8196-4578-b3bf-bfd5aba77caa could not be found. {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:28:27.364737 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0a7ad6eb-4fd5-43ea-8d40-6cf846c09b9d tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa" status: 404 len: 111 microversion: 2.1 time: 0.102523 Dec 20 09:28:27.365734 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 11/40] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Dec 20 09:28:27 2021] GET /compute/v2.1/os-snapshots/572a1c8e-8196-4578-b3bf-bfd5aba77caa => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 20 09:28:27.374324 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a937e22f-1f39-4b11-b6f8-119a1aa0b291 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Calling method '.version_select at 0x7f914f625af0>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:27.511124 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3569c896-2c4e-4a2e-a758-394fa54b0bbd tempest-VolumesTestJSON-1530434249 tempest-VolumesTestJSON-1530434249-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.163529 Dec 20 09:28:27.513792 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 30/41] 10.222.0.62 () {58 vars in 1154 bytes} [Mon Dec 20 09:28:27 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:27.782783 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f8845f8d-9aa7-4946-86da-fc1717de4cb8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:27.783395 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f8845f8d-9aa7-4946-86da-fc1717de4cb8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:27.913545 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f8845f8d-9aa7-4946-86da-fc1717de4cb8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:27.931808 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f8845f8d-9aa7-4946-86da-fc1717de4cb8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1221 microversion: 2.1 time: 0.150917 Dec 20 09:28:27.945362 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 31/42] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:27 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1221 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:28:27.979574 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1ea5c938-0881-4548-8374-728559e86491 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:27.990992 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-1ea5c938-0881-4548-8374-728559e86491 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:28.010648 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1ea5c938-0881-4548-8374-728559e86491 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:28.016458 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1ea5c938-0881-4548-8374-728559e86491 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:28.016458 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1ea5c938-0881-4548-8374-728559e86491 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:28.016458 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1ea5c938-0881-4548-8374-728559e86491 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:28.017389 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a937e22f-1f39-4b11-b6f8-119a1aa0b291 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/25dfc13e-103c-40e7-a660-b4e74162765a" status: 202 len: 0 microversion: 2.1 time: 0.644457 Dec 20 09:28:28.017389 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 12/43] 10.222.0.62 () {58 vars in 1247 bytes} [Mon Dec 20 09:28:27 2021] DELETE /compute/v2.1/os-volumes/25dfc13e-103c-40e7-a660-b4e74162765a => generated 0 bytes in 646 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:28:28.025755 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4bc4e8fc-ffad-42e8-8d74-25e7dad8068e tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Calling method '.version_select at 0x7f914f68ae50>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:28.283651 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4bc4e8fc-ffad-42e8-8d74-25e7dad8068e tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/25dfc13e-103c-40e7-a660-b4e74162765a" status: 200 len: 345 microversion: 2.1 time: 0.253396 Dec 20 09:28:28.283651 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 13/44] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 20 09:28:28 2021] GET /compute/v2.1/os-volumes/25dfc13e-103c-40e7-a660-b4e74162765a => generated 345 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:28:28.580658 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1ea5c938-0881-4548-8374-728559e86491 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:28.591411 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1ea5c938-0881-4548-8374-728559e86491 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.644222 Dec 20 09:28:28.597882 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 32/45] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:27 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:28.951300 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-08b354ca-5e40-498f-982d-d648df4c193b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:28.952529 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-08b354ca-5e40-498f-982d-d648df4c193b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:28.972763 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-08b354ca-5e40-498f-982d-d648df4c193b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:28.977149 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-08b354ca-5e40-498f-982d-d648df4c193b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:28.978628 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-08b354ca-5e40-498f-982d-d648df4c193b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:28.980152 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-08b354ca-5e40-498f-982d-d648df4c193b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:29.000204 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-fb9a5475-f9f2-4ecd-941f-60a67190a207 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-863485811", "imageRef": "6f828f0b-c445-46a5-9960-492746785ef3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c447227-4876-4dd2-a864-17e79eef283a"}], "security_groups": [{"name": "tempest-securitygroup--1706567666"}], "key_name": "tempest-keypair-1885543107", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:28:29.228732 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-08b354ca-5e40-498f-982d-d648df4c193b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:29.260828 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-08b354ca-5e40-498f-982d-d648df4c193b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1217 microversion: 2.1 time: 0.314369 Dec 20 09:28:29.275950 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 14/46] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:28 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1217 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:29.291121 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f193a8e2-e3b4-416a-8468-92f0ec5399c6 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Calling method '.version_select at 0x7f914f625280>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:29.379461 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-f193a8e2-e3b4-416a-8468-92f0ec5399c6 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] HTTP exception thrown: Volume 25dfc13e-103c-40e7-a660-b4e74162765a could not be found. Dec 20 09:28:29.380205 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f193a8e2-e3b4-416a-8468-92f0ec5399c6 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Returning 404 to user: Volume 25dfc13e-103c-40e7-a660-b4e74162765a could not be found. {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:28:29.381260 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f193a8e2-e3b4-416a-8468-92f0ec5399c6 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/25dfc13e-103c-40e7-a660-b4e74162765a" status: 404 len: 109 microversion: 2.1 time: 0.094378 Dec 20 09:28:29.382289 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 15/47] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 20 09:28:29 2021] GET /compute/v2.1/os-volumes/25dfc13e-103c-40e7-a660-b4e74162765a => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:28:29.412547 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.network.neutron [None req-fb9a5475-f9f2-4ecd-941f-60a67190a207 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] validate_networks() for [('1c447227-4876-4dd2-a864-17e79eef283a', None, None, None, None, None)] {{(pid=116674) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 09:28:29.414501 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c964007b-d486-4db5-954e-21a5ffb7f5ab tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Calling method '.version_select at 0x7f914f62c790>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:29.494421 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-c964007b-d486-4db5-954e-21a5ffb7f5ab tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] HTTP exception thrown: Volume 25dfc13e-103c-40e7-a660-b4e74162765a could not be found. Dec 20 09:28:29.509020 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c964007b-d486-4db5-954e-21a5ffb7f5ab tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Returning 404 to user: Volume 25dfc13e-103c-40e7-a660-b4e74162765a could not be found. {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:28:29.510003 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c964007b-d486-4db5-954e-21a5ffb7f5ab tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/25dfc13e-103c-40e7-a660-b4e74162765a" status: 404 len: 109 microversion: 2.1 time: 0.109623 Dec 20 09:28:29.510675 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 16/48] 10.222.0.62 () {58 vars in 1247 bytes} [Mon Dec 20 09:28:29 2021] DELETE /compute/v2.1/os-volumes/25dfc13e-103c-40e7-a660-b4e74162765a => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 20 09:28:29.528785 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ba5d5322-6de4-4eae-bc44-407a37d1f868 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Calling method '.version_select at 0x7f914f6250d0>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:29.636496 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-ba5d5322-6de4-4eae-bc44-407a37d1f868 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] HTTP exception thrown: Volume 25dfc13e-103c-40e7-a660-b4e74162765a could not be found. Dec 20 09:28:29.636496 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ba5d5322-6de4-4eae-bc44-407a37d1f868 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] Returning 404 to user: Volume 25dfc13e-103c-40e7-a660-b4e74162765a could not be found. {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:28:29.636496 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ba5d5322-6de4-4eae-bc44-407a37d1f868 tempest-VolumesSnapshotsTestJSON-782204181 tempest-VolumesSnapshotsTestJSON-782204181-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/25dfc13e-103c-40e7-a660-b4e74162765a" status: 404 len: 109 microversion: 2.1 time: 0.095529 Dec 20 09:28:29.636496 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 17/49] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 20 09:28:29 2021] GET /compute/v2.1/os-volumes/25dfc13e-103c-40e7-a660-b4e74162765a => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:28:29.640374 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-35e13a4c-8654-424b-9e40-d521ee287983 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:29.642458 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-35e13a4c-8654-424b-9e40-d521ee287983 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:29.661829 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-35e13a4c-8654-424b-9e40-d521ee287983 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:29.669415 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-35e13a4c-8654-424b-9e40-d521ee287983 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:29.671396 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-35e13a4c-8654-424b-9e40-d521ee287983 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:29.672023 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-35e13a4c-8654-424b-9e40-d521ee287983 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:30.021542 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-35e13a4c-8654-424b-9e40-d521ee287983 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:30.050835 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-35e13a4c-8654-424b-9e40-d521ee287983 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.432119 Dec 20 09:28:30.055404 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 18/50] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:29 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:30.377227 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2b7e703a-4a7c-4394-945f-03cc8c8d36ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:30.377227 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2b7e703a-4a7c-4394-945f-03cc8c8d36ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:30.377227 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2b7e703a-4a7c-4394-945f-03cc8c8d36ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:30.377227 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2b7e703a-4a7c-4394-945f-03cc8c8d36ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:30.378235 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2b7e703a-4a7c-4394-945f-03cc8c8d36ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:30.378235 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2b7e703a-4a7c-4394-945f-03cc8c8d36ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:30.378235 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-2b7e703a-4a7c-4394-945f-03cc8c8d36ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:30.394326 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2b7e703a-4a7c-4394-945f-03cc8c8d36ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1273 microversion: 2.1 time: 0.108870 Dec 20 09:28:30.396650 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 19/51] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:30 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1273 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:28:31.077777 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2c1628a6-899b-4a54-81f4-9a7d2003a591 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:31.082282 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2c1628a6-899b-4a54-81f4-9a7d2003a591 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:31.098593 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2c1628a6-899b-4a54-81f4-9a7d2003a591 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:31.101526 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2c1628a6-899b-4a54-81f4-9a7d2003a591 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:31.113616 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2c1628a6-899b-4a54-81f4-9a7d2003a591 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:31.115888 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2c1628a6-899b-4a54-81f4-9a7d2003a591 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:31.695257 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-fb9a5475-f9f2-4ecd-941f-60a67190a207 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Flavor limits 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 09:28:31.696567 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-fb9a5475-f9f2-4ecd-941f-60a67190a207 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Image limits 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 09:28:31.699997 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-fb9a5475-f9f2-4ecd-941f-60a67190a207 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Flavor pref 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 09:28:31.702204 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-fb9a5475-f9f2-4ecd-941f-60a67190a207 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Image pref 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 09:28:31.703172 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-fb9a5475-f9f2-4ecd-941f-60a67190a207 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 09:28:31.740878 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fb9a5475-f9f2-4ecd-941f-60a67190a207 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:31.741628 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fb9a5475-f9f2-4ecd-941f-60a67190a207 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:31.748128 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fb9a5475-f9f2-4ecd-941f-60a67190a207 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:31.748128 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fb9a5475-f9f2-4ecd-941f-60a67190a207 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:31.857995 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-fb9a5475-f9f2-4ecd-941f-60a67190a207 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Getting quotas for project b2ad93eaa3c541839f4737919bf7dc8c. Resources: {'ram', 'cores', 'instances'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:28:31.870442 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-fb9a5475-f9f2-4ecd-941f-60a67190a207 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Getting quotas for user b25e3e674c0e4530b1760b2a9d769851 and project b2ad93eaa3c541839f4737919bf7dc8c. Resources: {'ram', 'cores', 'instances'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:28:31.912570 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-fb9a5475-f9f2-4ecd-941f-60a67190a207 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Going to run 1 instances... {{(pid=116674) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 09:28:31.912570 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-fb9a5475-f9f2-4ecd-941f-60a67190a207 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f828f0b-c445-46a5-9960-492746785ef3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 09:28:32.127200 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-2c1628a6-899b-4a54-81f4-9a7d2003a591 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:32.141363 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2c1628a6-899b-4a54-81f4-9a7d2003a591 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 1.073335 Dec 20 09:28:32.152002 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 20/52] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:31 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:28:32.170533 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a5f8ddbb-1162-46a6-95d0-68f88c6aa6f6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:32.171980 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a5f8ddbb-1162-46a6-95d0-68f88c6aa6f6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:32.191541 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a5f8ddbb-1162-46a6-95d0-68f88c6aa6f6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:32.191541 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a5f8ddbb-1162-46a6-95d0-68f88c6aa6f6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:32.191541 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a5f8ddbb-1162-46a6-95d0-68f88c6aa6f6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:32.192583 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a5f8ddbb-1162-46a6-95d0-68f88c6aa6f6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:32.263510 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-fb9a5475-f9f2-4ecd-941f-60a67190a207 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.268025 Dec 20 09:28:32.264928 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 33/53] 10.222.0.62 () {62 vars in 1187 bytes} [Mon Dec 20 09:28:28 2021] POST /compute/v2.1/servers => generated 402 bytes in 3270 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 20 09:28:32.276215 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-47980eb3-92b8-4de3-af7c-f103c54d727c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:32.280946 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-47980eb3-92b8-4de3-af7c-f103c54d727c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:32.497426 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a5f8ddbb-1162-46a6-95d0-68f88c6aa6f6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:32.505969 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a5f8ddbb-1162-46a6-95d0-68f88c6aa6f6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1281 microversion: 2.1 time: 0.350707 Dec 20 09:28:32.509135 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-47980eb3-92b8-4de3-af7c-f103c54d727c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:32.516539 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-47980eb3-92b8-4de3-af7c-f103c54d727c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:32.518057 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-47980eb3-92b8-4de3-af7c-f103c54d727c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:32.518772 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 21/54] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:32 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1281 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:32.525562 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-47980eb3-92b8-4de3-af7c-f103c54d727c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1281 microversion: 2.20 time: 0.253453 Dec 20 09:28:32.552393 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 34/55] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:28:32 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1281 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:28:33.160250 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f18dba5a-ef7f-4a6e-b25d-1fe77e1bd3bd tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:33.160872 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f18dba5a-ef7f-4a6e-b25d-1fe77e1bd3bd tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:33.171821 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f18dba5a-ef7f-4a6e-b25d-1fe77e1bd3bd tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:33.177237 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f18dba5a-ef7f-4a6e-b25d-1fe77e1bd3bd tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:33.178656 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f18dba5a-ef7f-4a6e-b25d-1fe77e1bd3bd tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:33.189300 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f18dba5a-ef7f-4a6e-b25d-1fe77e1bd3bd tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:33.525858 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-02cf61fd-7e6c-46bb-9561-440b80c4c6da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:33.525858 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-02cf61fd-7e6c-46bb-9561-440b80c4c6da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:33.539250 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-02cf61fd-7e6c-46bb-9561-440b80c4c6da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:33.540051 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-02cf61fd-7e6c-46bb-9561-440b80c4c6da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:33.542499 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-02cf61fd-7e6c-46bb-9561-440b80c4c6da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:33.543828 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-02cf61fd-7e6c-46bb-9561-440b80c4c6da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:33.806276 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-02cf61fd-7e6c-46bb-9561-440b80c4c6da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:33.819054 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-02cf61fd-7e6c-46bb-9561-440b80c4c6da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1279 microversion: 2.1 time: 0.297822 Dec 20 09:28:33.828363 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 35/56] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:33 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1279 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:28:33.833268 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b4332ed0-caad-4519-8843-7aa80ba5a513 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:33.843939 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b4332ed0-caad-4519-8843-7aa80ba5a513 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:33.913809 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f18dba5a-ef7f-4a6e-b25d-1fe77e1bd3bd tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:33.927917 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f18dba5a-ef7f-4a6e-b25d-1fe77e1bd3bd tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.769082 Dec 20 09:28:33.936531 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 22/57] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:33 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:34.036907 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b4332ed0-caad-4519-8843-7aa80ba5a513 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:34.047644 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b4332ed0-caad-4519-8843-7aa80ba5a513 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:34.049740 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b4332ed0-caad-4519-8843-7aa80ba5a513 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:34.051643 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b4332ed0-caad-4519-8843-7aa80ba5a513 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1281 microversion: 2.20 time: 0.228892 Dec 20 09:28:34.087631 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 36/58] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:28:33 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1281 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:28:34.664675 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-a98d44c1-fa18-4f5e-86c4-b0a9517fce82 req-b0ee88c5-f822-4216-b73f-f7caa2ea4299 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "632d2ff5-8fa8-4c1f-8bf0-de64b20de339", "tag": "ab78a4d5-9785-4d8f-a076-dcb2076e8cb1"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:28:34.664675 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:28:34.664675 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:28:34.664675 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-a98d44c1-fa18-4f5e-86c4-b0a9517fce82 req-b0ee88c5-f822-4216-b73f-f7caa2ea4299 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:34.664675 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-a98d44c1-fa18-4f5e-86c4-b0a9517fce82 req-b0ee88c5-f822-4216-b73f-f7caa2ea4299 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:34.753062 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-a98d44c1-fa18-4f5e-86c4-b0a9517fce82 req-b0ee88c5-f822-4216-b73f-f7caa2ea4299 service nova] Creating event network-changed:ab78a4d5-9785-4d8f-a076-dcb2076e8cb1 for instance 632d2ff5-8fa8-4c1f-8bf0-de64b20de339 on hv-cinder-81908 Dec 20 09:28:34.759785 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-a98d44c1-fa18-4f5e-86c4-b0a9517fce82 req-b0ee88c5-f822-4216-b73f-f7caa2ea4299 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116675) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 20 09:28:34.776162 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-290d1669-df01-4663-b14d-f71d85eaaece None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:34.776162 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-290d1669-df01-4663-b14d-f71d85eaaece None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:34.776162 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-290d1669-df01-4663-b14d-f71d85eaaece None None] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:34.777729 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-290d1669-df01-4663-b14d-f71d85eaaece None None] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:34.800426 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.compute.rpcapi [None req-290d1669-df01-4663-b14d-f71d85eaaece None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 20 09:28:34.800426 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-290d1669-df01-4663-b14d-f71d85eaaece None None] Releasing lock "compute-rpcapi-router" {{(pid=116675) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 20 09:28:34.845334 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3ba6769d-e755-44d0-a6bb-ff6eaa998a62 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:34.849054 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-3ba6769d-e755-44d0-a6bb-ff6eaa998a62 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:34.872097 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3ba6769d-e755-44d0-a6bb-ff6eaa998a62 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:34.888727 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-290d1669-df01-4663-b14d-f71d85eaaece None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.776381 Dec 20 09:28:34.891354 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3ba6769d-e755-44d0-a6bb-ff6eaa998a62 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:34.892088 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 23/59] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:28:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:28:34.901383 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3ba6769d-e755-44d0-a6bb-ff6eaa998a62 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:34.907496 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3ba6769d-e755-44d0-a6bb-ff6eaa998a62 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:35.018946 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-bac66e51-2f19-42f9-bd8b-926645532e23 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:35.018946 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-bac66e51-2f19-42f9-bd8b-926645532e23 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:35.018946 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bac66e51-2f19-42f9-bd8b-926645532e23 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:35.018946 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bac66e51-2f19-42f9-bd8b-926645532e23 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:35.019589 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bac66e51-2f19-42f9-bd8b-926645532e23 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:35.019589 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bac66e51-2f19-42f9-bd8b-926645532e23 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:35.439456 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3ba6769d-e755-44d0-a6bb-ff6eaa998a62 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:35.444726 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-bac66e51-2f19-42f9-bd8b-926645532e23 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:35.448522 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3ba6769d-e755-44d0-a6bb-ff6eaa998a62 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.614290 Dec 20 09:28:35.453110 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-bac66e51-2f19-42f9-bd8b-926645532e23 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.515110 Dec 20 09:28:35.462664 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 37/60] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:34 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:28:35.463424 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 24/61] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:34 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:28:35.468877 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4cf7feed-7f8b-49a5-8336-1080be50617c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:35.474696 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-4cf7feed-7f8b-49a5-8336-1080be50617c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:35.499648 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4cf7feed-7f8b-49a5-8336-1080be50617c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:35.500287 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4cf7feed-7f8b-49a5-8336-1080be50617c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:35.501176 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4cf7feed-7f8b-49a5-8336-1080be50617c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:35.501695 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4cf7feed-7f8b-49a5-8336-1080be50617c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:35.662270 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-4cf7feed-7f8b-49a5-8336-1080be50617c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:35.662270 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-4cf7feed-7f8b-49a5-8336-1080be50617c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:35.663868 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-4cf7feed-7f8b-49a5-8336-1080be50617c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:35.663868 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-4cf7feed-7f8b-49a5-8336-1080be50617c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1277 microversion: 2.20 time: 0.133309 Dec 20 09:28:35.663868 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 38/62] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:28:35 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1277 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:28:36.477851 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3b1e48f0-d72b-4db4-96a7-4ff24a1e59de tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:36.479214 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-3b1e48f0-d72b-4db4-96a7-4ff24a1e59de tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:36.483123 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-75fc9023-a935-4c9f-ad3b-25b10edb65ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:36.484113 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-75fc9023-a935-4c9f-ad3b-25b10edb65ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:36.493861 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-75fc9023-a935-4c9f-ad3b-25b10edb65ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:36.494079 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3b1e48f0-d72b-4db4-96a7-4ff24a1e59de tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:36.494540 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3b1e48f0-d72b-4db4-96a7-4ff24a1e59de tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:36.494985 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-75fc9023-a935-4c9f-ad3b-25b10edb65ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:36.495462 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3b1e48f0-d72b-4db4-96a7-4ff24a1e59de tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:36.496374 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3b1e48f0-d72b-4db4-96a7-4ff24a1e59de tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:36.496545 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-75fc9023-a935-4c9f-ad3b-25b10edb65ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:36.497064 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-75fc9023-a935-4c9f-ad3b-25b10edb65ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:36.870880 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-75fc9023-a935-4c9f-ad3b-25b10edb65ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:36.877605 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-75fc9023-a935-4c9f-ad3b-25b10edb65ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.405716 Dec 20 09:28:36.898972 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 25/63] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:36 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:36.919168 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-23e0b295-2b27-4e6d-8605-00a79dc1e5ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:36.923391 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-23e0b295-2b27-4e6d-8605-00a79dc1e5ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:36.943053 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3b1e48f0-d72b-4db4-96a7-4ff24a1e59de tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:36.944825 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-23e0b295-2b27-4e6d-8605-00a79dc1e5ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:36.945920 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-23e0b295-2b27-4e6d-8605-00a79dc1e5ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:36.947798 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-23e0b295-2b27-4e6d-8605-00a79dc1e5ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:36.949375 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-23e0b295-2b27-4e6d-8605-00a79dc1e5ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:36.950971 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3b1e48f0-d72b-4db4-96a7-4ff24a1e59de tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.482593 Dec 20 09:28:36.955612 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 39/64] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:36 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:36.963100 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-7c7518c5-7f57-449c-9e19-63ff7b911b7a req-6efa8a6e-3dd7-4972-ac34-55c9087c560b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af8e934-5860-485f-abf5-42a2814d66e7", "tag": "400b05c3-3434-415b-b982-6014d3a882ac"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:28:36.973002 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:28:36.973002 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:28:36.990902 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-7c7518c5-7f57-449c-9e19-63ff7b911b7a req-6efa8a6e-3dd7-4972-ac34-55c9087c560b service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:36.997874 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-7c7518c5-7f57-449c-9e19-63ff7b911b7a req-6efa8a6e-3dd7-4972-ac34-55c9087c560b service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:37.081401 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-7c7518c5-7f57-449c-9e19-63ff7b911b7a req-6efa8a6e-3dd7-4972-ac34-55c9087c560b service nova] Creating event network-changed:400b05c3-3434-415b-b982-6014d3a882ac for instance 1af8e934-5860-485f-abf5-42a2814d66e7 on hv-cinder-81908 Dec 20 09:28:37.082117 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-7c7518c5-7f57-449c-9e19-63ff7b911b7a req-6efa8a6e-3dd7-4972-ac34-55c9087c560b service nova] Acquired lock "compute-rpcapi-router" {{(pid=116674) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 20 09:28:37.083418 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-438286c8-11f6-4a81-a5bf-e39d0c9e3653 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:37.083969 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-438286c8-11f6-4a81-a5bf-e39d0c9e3653 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:37.091784 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-438286c8-11f6-4a81-a5bf-e39d0c9e3653 None None] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:37.093138 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-438286c8-11f6-4a81-a5bf-e39d0c9e3653 None None] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:37.230694 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.compute.rpcapi [None req-438286c8-11f6-4a81-a5bf-e39d0c9e3653 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 20 09:28:37.230694 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-438286c8-11f6-4a81-a5bf-e39d0c9e3653 None None] Releasing lock "compute-rpcapi-router" {{(pid=116674) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 20 09:28:37.231618 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-23e0b295-2b27-4e6d-8605-00a79dc1e5ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:37.232110 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-438286c8-11f6-4a81-a5bf-e39d0c9e3653 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.244782 Dec 20 09:28:37.232110 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 40/65] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:28:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:28:37.232725 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-23e0b295-2b27-4e6d-8605-00a79dc1e5ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:37.232725 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-23e0b295-2b27-4e6d-8605-00a79dc1e5ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:37.232725 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-23e0b295-2b27-4e6d-8605-00a79dc1e5ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1333 microversion: 2.20 time: 0.308960 Dec 20 09:28:37.233051 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 26/66] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:28:36 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1333 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:28:37.900587 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-04933b91-9927-463e-ae67-17ba6ac46898 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:37.902066 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-04933b91-9927-463e-ae67-17ba6ac46898 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:37.915576 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-04933b91-9927-463e-ae67-17ba6ac46898 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:37.918721 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-04933b91-9927-463e-ae67-17ba6ac46898 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:37.920552 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-04933b91-9927-463e-ae67-17ba6ac46898 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:37.923503 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-04933b91-9927-463e-ae67-17ba6ac46898 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:37.972365 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0e2310d5-f6d3-483a-9a85-2c3540d3fa64 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:37.973000 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0e2310d5-f6d3-483a-9a85-2c3540d3fa64 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:37.983395 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0e2310d5-f6d3-483a-9a85-2c3540d3fa64 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:37.983957 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0e2310d5-f6d3-483a-9a85-2c3540d3fa64 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:37.985552 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0e2310d5-f6d3-483a-9a85-2c3540d3fa64 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:37.986200 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0e2310d5-f6d3-483a-9a85-2c3540d3fa64 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:38.251257 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-04933b91-9927-463e-ae67-17ba6ac46898 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:38.263888 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-04933b91-9927-463e-ae67-17ba6ac46898 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.367663 Dec 20 09:28:38.265081 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 41/67] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:37 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:28:38.295821 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-0e2310d5-f6d3-483a-9a85-2c3540d3fa64 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:38.309407 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0e2310d5-f6d3-483a-9a85-2c3540d3fa64 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.342659 Dec 20 09:28:38.310230 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 27/68] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:37 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:38.331415 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-16809fa6-110f-46fb-83d3-f063cfeccf2c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:38.332249 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-16809fa6-110f-46fb-83d3-f063cfeccf2c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:38.338411 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-16809fa6-110f-46fb-83d3-f063cfeccf2c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:38.343503 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-16809fa6-110f-46fb-83d3-f063cfeccf2c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:38.344769 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-16809fa6-110f-46fb-83d3-f063cfeccf2c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:38.345219 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-16809fa6-110f-46fb-83d3-f063cfeccf2c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:38.568548 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-14fe14d8-25c5-4d8d-b4c3-47818c552ba5 req-e93f6ae7-d984-4a26-9597-6b608dbd61e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb93a254-d6ca-433b-8317-d0a21f49cdf9", "tag": "87d44c65-d907-4b8c-b972-32c1d837d695"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:28:38.574603 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:28:38.574603 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:28:38.590970 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-14fe14d8-25c5-4d8d-b4c3-47818c552ba5 req-e93f6ae7-d984-4a26-9597-6b608dbd61e2 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:38.593120 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-16809fa6-110f-46fb-83d3-f063cfeccf2c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:38.593455 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-14fe14d8-25c5-4d8d-b4c3-47818c552ba5 req-e93f6ae7-d984-4a26-9597-6b608dbd61e2 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:38.603327 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-16809fa6-110f-46fb-83d3-f063cfeccf2c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:38.605577 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-16809fa6-110f-46fb-83d3-f063cfeccf2c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:38.606756 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-16809fa6-110f-46fb-83d3-f063cfeccf2c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1333 microversion: 2.20 time: 0.294999 Dec 20 09:28:38.607495 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 28/69] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:28:38 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1333 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:28:38.617920 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-14fe14d8-25c5-4d8d-b4c3-47818c552ba5 req-e93f6ae7-d984-4a26-9597-6b608dbd61e2 service nova] Creating event network-changed:87d44c65-d907-4b8c-b972-32c1d837d695 for instance eb93a254-d6ca-433b-8317-d0a21f49cdf9 on hv-cinder-81908 Dec 20 09:28:38.623190 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-14fe14d8-25c5-4d8d-b4c3-47818c552ba5 req-e93f6ae7-d984-4a26-9597-6b608dbd61e2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.356711 Dec 20 09:28:38.624101 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 42/70] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:28:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:28:39.280177 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9096605e-d60c-4522-a7f0-043741d1283c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:39.280780 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9096605e-d60c-4522-a7f0-043741d1283c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:39.286703 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9096605e-d60c-4522-a7f0-043741d1283c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:39.287156 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9096605e-d60c-4522-a7f0-043741d1283c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:39.287955 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9096605e-d60c-4522-a7f0-043741d1283c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:39.288390 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9096605e-d60c-4522-a7f0-043741d1283c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:39.337620 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ec349279-98d5-41dd-b7d2-d3efee705180 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:39.343639 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ec349279-98d5-41dd-b7d2-d3efee705180 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:39.345574 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ec349279-98d5-41dd-b7d2-d3efee705180 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:39.346082 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ec349279-98d5-41dd-b7d2-d3efee705180 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:39.347184 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ec349279-98d5-41dd-b7d2-d3efee705180 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:39.348078 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ec349279-98d5-41dd-b7d2-d3efee705180 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:39.473584 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-9096605e-d60c-4522-a7f0-043741d1283c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:39.485079 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9096605e-d60c-4522-a7f0-043741d1283c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.208416 Dec 20 09:28:39.490983 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 29/71] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:39 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:39.547704 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ec349279-98d5-41dd-b7d2-d3efee705180 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:39.556254 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ec349279-98d5-41dd-b7d2-d3efee705180 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.223056 Dec 20 09:28:39.557102 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 43/72] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:39 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:28:39.625553 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-5916e17a-824b-4c9f-ad88-2b8231a83885 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:39.626876 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-5916e17a-824b-4c9f-ad88-2b8231a83885 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:39.639214 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5916e17a-824b-4c9f-ad88-2b8231a83885 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:39.639706 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5916e17a-824b-4c9f-ad88-2b8231a83885 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:39.640501 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5916e17a-824b-4c9f-ad88-2b8231a83885 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:39.640970 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5916e17a-824b-4c9f-ad88-2b8231a83885 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:39.706990 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-5916e17a-824b-4c9f-ad88-2b8231a83885 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:39.714928 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-5916e17a-824b-4c9f-ad88-2b8231a83885 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:39.716477 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-5916e17a-824b-4c9f-ad88-2b8231a83885 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:39.717578 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-5916e17a-824b-4c9f-ad88-2b8231a83885 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1333 microversion: 2.20 time: 0.095867 Dec 20 09:28:39.718292 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 30/73] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:28:39 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1333 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:28:40.502846 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-46024bf9-a1c6-44b1-9bb4-ac566b977251 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:40.503376 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-46024bf9-a1c6-44b1-9bb4-ac566b977251 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:40.510230 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-46024bf9-a1c6-44b1-9bb4-ac566b977251 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:40.510760 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-46024bf9-a1c6-44b1-9bb4-ac566b977251 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:40.512140 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-46024bf9-a1c6-44b1-9bb4-ac566b977251 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:40.512651 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-46024bf9-a1c6-44b1-9bb4-ac566b977251 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:40.572760 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1afe83d5-534d-4f88-bd8f-66546ecbdf8c tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:40.573410 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1afe83d5-534d-4f88-bd8f-66546ecbdf8c tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:40.579226 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1afe83d5-534d-4f88-bd8f-66546ecbdf8c tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:40.579713 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1afe83d5-534d-4f88-bd8f-66546ecbdf8c tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:40.580497 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1afe83d5-534d-4f88-bd8f-66546ecbdf8c tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:40.580934 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1afe83d5-534d-4f88-bd8f-66546ecbdf8c tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:40.678791 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-46024bf9-a1c6-44b1-9bb4-ac566b977251 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:40.686742 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-46024bf9-a1c6-44b1-9bb4-ac566b977251 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.187582 Dec 20 09:28:40.687350 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 44/74] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:40 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:40.735619 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-dd7f18ca-c054-4e04-9aa7-269da403cf92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:40.736603 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-dd7f18ca-c054-4e04-9aa7-269da403cf92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:40.742838 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dd7f18ca-c054-4e04-9aa7-269da403cf92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:40.743288 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dd7f18ca-c054-4e04-9aa7-269da403cf92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:40.747239 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dd7f18ca-c054-4e04-9aa7-269da403cf92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:40.747239 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dd7f18ca-c054-4e04-9aa7-269da403cf92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:40.749079 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1afe83d5-534d-4f88-bd8f-66546ecbdf8c tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:40.759017 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1afe83d5-534d-4f88-bd8f-66546ecbdf8c tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.189826 Dec 20 09:28:40.759596 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 31/75] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:40 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:28:40.815864 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-dd7f18ca-c054-4e04-9aa7-269da403cf92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:40.827845 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-dd7f18ca-c054-4e04-9aa7-269da403cf92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:40.827845 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-dd7f18ca-c054-4e04-9aa7-269da403cf92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:40.827845 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-dd7f18ca-c054-4e04-9aa7-269da403cf92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1333 microversion: 2.20 time: 0.095329 Dec 20 09:28:40.828121 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 45/76] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:28:40 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1333 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:28:41.703226 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1bccb36d-920b-4ebd-8c71-ad02c6bdc2a9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:41.703890 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1bccb36d-920b-4ebd-8c71-ad02c6bdc2a9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:41.709618 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1bccb36d-920b-4ebd-8c71-ad02c6bdc2a9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:41.710070 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1bccb36d-920b-4ebd-8c71-ad02c6bdc2a9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:41.712931 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1bccb36d-920b-4ebd-8c71-ad02c6bdc2a9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:41.712931 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1bccb36d-920b-4ebd-8c71-ad02c6bdc2a9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:41.775251 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ab224e7a-c9cc-4fdf-aae3-a01af7cc8c61 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:41.776130 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ab224e7a-c9cc-4fdf-aae3-a01af7cc8c61 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:41.782165 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ab224e7a-c9cc-4fdf-aae3-a01af7cc8c61 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:41.782623 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ab224e7a-c9cc-4fdf-aae3-a01af7cc8c61 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:41.787531 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ab224e7a-c9cc-4fdf-aae3-a01af7cc8c61 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:41.787531 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ab224e7a-c9cc-4fdf-aae3-a01af7cc8c61 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:41.862237 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1bccb36d-920b-4ebd-8c71-ad02c6bdc2a9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:41.870419 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1bccb36d-920b-4ebd-8c71-ad02c6bdc2a9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.170444 Dec 20 09:28:41.870856 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 32/77] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:41 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:28:41.875507 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-525d0f62-b336-4477-9d2b-77d95d1be1b9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:41.876173 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-525d0f62-b336-4477-9d2b-77d95d1be1b9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:41.883572 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-525d0f62-b336-4477-9d2b-77d95d1be1b9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:41.884058 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-525d0f62-b336-4477-9d2b-77d95d1be1b9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:41.884860 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-525d0f62-b336-4477-9d2b-77d95d1be1b9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:41.885299 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-525d0f62-b336-4477-9d2b-77d95d1be1b9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:41.949697 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ab224e7a-c9cc-4fdf-aae3-a01af7cc8c61 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:41.957002 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ab224e7a-c9cc-4fdf-aae3-a01af7cc8c61 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.186142 Dec 20 09:28:41.959578 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 46/78] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:41 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:28:41.964730 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-525d0f62-b336-4477-9d2b-77d95d1be1b9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:41.972691 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-525d0f62-b336-4477-9d2b-77d95d1be1b9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:41.974197 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-525d0f62-b336-4477-9d2b-77d95d1be1b9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:41.975327 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-525d0f62-b336-4477-9d2b-77d95d1be1b9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1333 microversion: 2.20 time: 0.103556 Dec 20 09:28:41.975926 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 33/79] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:28:41 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1333 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:28:42.931371 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-10d992b9-f2ed-4b7c-9beb-0e41593b3b44 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:42.932560 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-10d992b9-f2ed-4b7c-9beb-0e41593b3b44 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:42.938326 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-10d992b9-f2ed-4b7c-9beb-0e41593b3b44 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:42.938779 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-10d992b9-f2ed-4b7c-9beb-0e41593b3b44 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:42.939597 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-10d992b9-f2ed-4b7c-9beb-0e41593b3b44 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:42.940070 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-10d992b9-f2ed-4b7c-9beb-0e41593b3b44 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:42.980272 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-394e17f7-57e5-4ee8-84fd-19ac165df2e6 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:42.980272 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-394e17f7-57e5-4ee8-84fd-19ac165df2e6 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:42.981081 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-394e17f7-57e5-4ee8-84fd-19ac165df2e6 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:42.981817 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-394e17f7-57e5-4ee8-84fd-19ac165df2e6 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:42.982688 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-394e17f7-57e5-4ee8-84fd-19ac165df2e6 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:42.983130 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-394e17f7-57e5-4ee8-84fd-19ac165df2e6 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:43.462099 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-10d992b9-f2ed-4b7c-9beb-0e41593b3b44 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:43.472995 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-10d992b9-f2ed-4b7c-9beb-0e41593b3b44 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.544510 Dec 20 09:28:43.475351 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 47/80] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:42 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:43.482907 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-842774ea-21ae-448e-8c52-909d0d65f7ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:43.491348 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-842774ea-21ae-448e-8c52-909d0d65f7ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:43.492455 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-842774ea-21ae-448e-8c52-909d0d65f7ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:43.493099 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-842774ea-21ae-448e-8c52-909d0d65f7ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:43.494073 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-842774ea-21ae-448e-8c52-909d0d65f7ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:43.494862 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-842774ea-21ae-448e-8c52-909d0d65f7ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:43.544617 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-394e17f7-57e5-4ee8-84fd-19ac165df2e6 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:43.554718 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-394e17f7-57e5-4ee8-84fd-19ac165df2e6 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.583938 Dec 20 09:28:43.565543 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 34/81] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:42 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:28:43.596238 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-842774ea-21ae-448e-8c52-909d0d65f7ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:43.606740 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-842774ea-21ae-448e-8c52-909d0d65f7ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:43.609361 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-842774ea-21ae-448e-8c52-909d0d65f7ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:43.611329 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-842774ea-21ae-448e-8c52-909d0d65f7ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1333 microversion: 2.20 time: 0.134623 Dec 20 09:28:43.612348 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 48/82] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:28:43 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1333 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:28:44.491571 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b2f9b230-f623-4efe-872f-265ae6eb5ee7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:44.492213 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b2f9b230-f623-4efe-872f-265ae6eb5ee7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:44.498573 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b2f9b230-f623-4efe-872f-265ae6eb5ee7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:44.499067 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b2f9b230-f623-4efe-872f-265ae6eb5ee7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:44.499885 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b2f9b230-f623-4efe-872f-265ae6eb5ee7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:44.500329 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b2f9b230-f623-4efe-872f-265ae6eb5ee7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:44.577108 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0634b172-851b-4b37-bb81-2a907778765b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:44.578226 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0634b172-851b-4b37-bb81-2a907778765b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:44.586865 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0634b172-851b-4b37-bb81-2a907778765b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:44.587507 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0634b172-851b-4b37-bb81-2a907778765b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:44.588352 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0634b172-851b-4b37-bb81-2a907778765b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:44.588786 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0634b172-851b-4b37-bb81-2a907778765b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:44.662314 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b2f9b230-f623-4efe-872f-265ae6eb5ee7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:44.671097 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b2f9b230-f623-4efe-872f-265ae6eb5ee7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.183250 Dec 20 09:28:44.672802 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 35/83] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:44 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:44.677339 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8d0f2463-abcd-40b5-a539-73b97e87d52d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:44.677932 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8d0f2463-abcd-40b5-a539-73b97e87d52d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:44.684631 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8d0f2463-abcd-40b5-a539-73b97e87d52d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:44.690348 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8d0f2463-abcd-40b5-a539-73b97e87d52d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:44.690348 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8d0f2463-abcd-40b5-a539-73b97e87d52d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:44.690348 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8d0f2463-abcd-40b5-a539-73b97e87d52d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:44.777840 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-0634b172-851b-4b37-bb81-2a907778765b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:44.779095 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8d0f2463-abcd-40b5-a539-73b97e87d52d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:44.787557 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0634b172-851b-4b37-bb81-2a907778765b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.217982 Dec 20 09:28:44.788503 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 49/84] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:44 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:44.792194 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8d0f2463-abcd-40b5-a539-73b97e87d52d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:44.794009 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8d0f2463-abcd-40b5-a539-73b97e87d52d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:44.798741 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8d0f2463-abcd-40b5-a539-73b97e87d52d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1341 microversion: 2.20 time: 0.121623 Dec 20 09:28:44.798741 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 36/85] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:28:44 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1341 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:28:45.687922 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d4f4bedc-39c3-43cf-ab99-d108f31ce4ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:45.688535 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d4f4bedc-39c3-43cf-ab99-d108f31ce4ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:45.694453 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d4f4bedc-39c3-43cf-ab99-d108f31ce4ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:45.694913 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d4f4bedc-39c3-43cf-ab99-d108f31ce4ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:45.695708 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d4f4bedc-39c3-43cf-ab99-d108f31ce4ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:45.696153 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d4f4bedc-39c3-43cf-ab99-d108f31ce4ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:45.811052 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e4c03eab-fb60-45f9-be80-d8ca9722acb6 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:45.812266 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e4c03eab-fb60-45f9-be80-d8ca9722acb6 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:45.818556 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e4c03eab-fb60-45f9-be80-d8ca9722acb6 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:45.819216 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e4c03eab-fb60-45f9-be80-d8ca9722acb6 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:45.823106 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e4c03eab-fb60-45f9-be80-d8ca9722acb6 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:45.823106 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e4c03eab-fb60-45f9-be80-d8ca9722acb6 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:45.851251 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d4f4bedc-39c3-43cf-ab99-d108f31ce4ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:45.858607 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d4f4bedc-39c3-43cf-ab99-d108f31ce4ce tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.174189 Dec 20 09:28:45.859210 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 50/86] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:45 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:45.863597 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-83f9f351-2143-4608-b7a7-e9024e4e7912 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:45.864594 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-83f9f351-2143-4608-b7a7-e9024e4e7912 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:45.874794 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-83f9f351-2143-4608-b7a7-e9024e4e7912 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:45.874794 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-83f9f351-2143-4608-b7a7-e9024e4e7912 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:45.874794 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-83f9f351-2143-4608-b7a7-e9024e4e7912 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:45.874794 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-83f9f351-2143-4608-b7a7-e9024e4e7912 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:45.970761 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-83f9f351-2143-4608-b7a7-e9024e4e7912 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:45.975951 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-83f9f351-2143-4608-b7a7-e9024e4e7912 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:45.983749 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-83f9f351-2143-4608-b7a7-e9024e4e7912 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:45.983749 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-83f9f351-2143-4608-b7a7-e9024e4e7912 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1341 microversion: 2.20 time: 0.123080 Dec 20 09:28:45.989149 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 51/87] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:28:45 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1341 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:28:46.063687 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e4c03eab-fb60-45f9-be80-d8ca9722acb6 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:46.072879 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e4c03eab-fb60-45f9-be80-d8ca9722acb6 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.265416 Dec 20 09:28:46.073477 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 37/88] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:45 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:46.874246 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8cf90bec-f5ed-4d75-8a26-665d24d780e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:46.874848 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-8cf90bec-f5ed-4d75-8a26-665d24d780e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:46.884134 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8cf90bec-f5ed-4d75-8a26-665d24d780e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:46.884134 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8cf90bec-f5ed-4d75-8a26-665d24d780e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:46.884134 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8cf90bec-f5ed-4d75-8a26-665d24d780e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:46.884134 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8cf90bec-f5ed-4d75-8a26-665d24d780e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:47.008456 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c5950dad-e55d-4989-be28-bc445c56c988 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:47.009083 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c5950dad-e55d-4989-be28-bc445c56c988 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:47.015030 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c5950dad-e55d-4989-be28-bc445c56c988 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:47.015483 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c5950dad-e55d-4989-be28-bc445c56c988 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:47.016728 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c5950dad-e55d-4989-be28-bc445c56c988 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:47.017171 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c5950dad-e55d-4989-be28-bc445c56c988 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:47.088472 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-c5950dad-e55d-4989-be28-bc445c56c988 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:47.092373 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-8cf90bec-f5ed-4d75-8a26-665d24d780e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:47.097938 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-c5950dad-e55d-4989-be28-bc445c56c988 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:47.099857 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-c5950dad-e55d-4989-be28-bc445c56c988 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:47.101102 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c5950dad-e55d-4989-be28-bc445c56c988 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1351 microversion: 2.20 time: 0.098186 Dec 20 09:28:47.101846 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8cf90bec-f5ed-4d75-8a26-665d24d780e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.231359 Dec 20 09:28:47.102990 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 52/89] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:46 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:47.109656 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-db88a349-7a02-4bb2-b925-25154533c6cd tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:47.110406 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-db88a349-7a02-4bb2-b925-25154533c6cd tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:47.117829 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 38/90] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:28:47 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:28:47.121167 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-db88a349-7a02-4bb2-b925-25154533c6cd tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:47.121167 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-db88a349-7a02-4bb2-b925-25154533c6cd tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:47.121167 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-db88a349-7a02-4bb2-b925-25154533c6cd tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:47.121678 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-db88a349-7a02-4bb2-b925-25154533c6cd tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:47.422637 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-db88a349-7a02-4bb2-b925-25154533c6cd tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:47.430954 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-db88a349-7a02-4bb2-b925-25154533c6cd tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.326556 Dec 20 09:28:47.437485 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 53/91] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:47 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:48.118864 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d3581d0c-6423-4be1-bd22-d50f32414a0d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:48.119471 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d3581d0c-6423-4be1-bd22-d50f32414a0d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:48.125729 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d3581d0c-6423-4be1-bd22-d50f32414a0d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:48.126375 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d3581d0c-6423-4be1-bd22-d50f32414a0d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:48.127350 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d3581d0c-6423-4be1-bd22-d50f32414a0d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:48.127982 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d3581d0c-6423-4be1-bd22-d50f32414a0d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:48.128239 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-dd311ead-ba69-40e7-af92-b40b17dfe0be tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:48.129127 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-dd311ead-ba69-40e7-af92-b40b17dfe0be tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:48.135381 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dd311ead-ba69-40e7-af92-b40b17dfe0be tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:48.135861 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dd311ead-ba69-40e7-af92-b40b17dfe0be tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:48.136656 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dd311ead-ba69-40e7-af92-b40b17dfe0be tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:48.137198 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dd311ead-ba69-40e7-af92-b40b17dfe0be tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:48.246718 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d3581d0c-6423-4be1-bd22-d50f32414a0d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:48.255268 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d3581d0c-6423-4be1-bd22-d50f32414a0d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:48.256898 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d3581d0c-6423-4be1-bd22-d50f32414a0d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:48.258208 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d3581d0c-6423-4be1-bd22-d50f32414a0d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1351 microversion: 2.20 time: 0.143628 Dec 20 09:28:48.258835 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 39/92] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:28:48 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1351 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:28:48.382522 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-dd311ead-ba69-40e7-af92-b40b17dfe0be tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:48.390961 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-dd311ead-ba69-40e7-af92-b40b17dfe0be tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.266356 Dec 20 09:28:48.408410 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 54/93] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:48 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:28:48.447470 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e4fffecb-9ba3-4536-beb5-5833fc723357 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:48.449355 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e4fffecb-9ba3-4536-beb5-5833fc723357 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:48.469946 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e4fffecb-9ba3-4536-beb5-5833fc723357 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:48.470508 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e4fffecb-9ba3-4536-beb5-5833fc723357 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:48.471356 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e4fffecb-9ba3-4536-beb5-5833fc723357 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:48.478087 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e4fffecb-9ba3-4536-beb5-5833fc723357 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:48.848006 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e4fffecb-9ba3-4536-beb5-5833fc723357 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:48.856758 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e4fffecb-9ba3-4536-beb5-5833fc723357 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.413232 Dec 20 09:28:48.858024 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 40/94] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:48 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:49.284200 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f126b01e-c5f1-4889-9097-8ed79da0fe7c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:49.284200 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f126b01e-c5f1-4889-9097-8ed79da0fe7c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:49.285375 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f126b01e-c5f1-4889-9097-8ed79da0fe7c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:49.285835 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f126b01e-c5f1-4889-9097-8ed79da0fe7c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:49.286636 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f126b01e-c5f1-4889-9097-8ed79da0fe7c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:49.287082 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f126b01e-c5f1-4889-9097-8ed79da0fe7c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:49.408335 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1596313b-b143-4cfd-a63c-d3bb41f03f04 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:49.408939 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1596313b-b143-4cfd-a63c-d3bb41f03f04 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:49.422179 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1596313b-b143-4cfd-a63c-d3bb41f03f04 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:49.422630 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1596313b-b143-4cfd-a63c-d3bb41f03f04 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:49.423429 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1596313b-b143-4cfd-a63c-d3bb41f03f04 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:49.423897 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1596313b-b143-4cfd-a63c-d3bb41f03f04 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:49.524473 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f126b01e-c5f1-4889-9097-8ed79da0fe7c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:49.534723 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f126b01e-c5f1-4889-9097-8ed79da0fe7c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:49.536740 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f126b01e-c5f1-4889-9097-8ed79da0fe7c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:49.538437 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f126b01e-c5f1-4889-9097-8ed79da0fe7c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1407 microversion: 2.20 time: 0.266129 Dec 20 09:28:49.550231 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 55/95] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:28:49 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:28:49.684306 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1596313b-b143-4cfd-a63c-d3bb41f03f04 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:49.696217 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1596313b-b143-4cfd-a63c-d3bb41f03f04 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.290600 Dec 20 09:28:49.696770 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 41/96] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:49 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:49.878434 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-2bf78c9b-04ae-4f82-b465-5dd55db100cc tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:49.879304 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-2bf78c9b-04ae-4f82-b465-5dd55db100cc tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:49.885820 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2bf78c9b-04ae-4f82-b465-5dd55db100cc tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:49.886260 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2bf78c9b-04ae-4f82-b465-5dd55db100cc tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:49.887230 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2bf78c9b-04ae-4f82-b465-5dd55db100cc tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:49.888275 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2bf78c9b-04ae-4f82-b465-5dd55db100cc tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:50.139434 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-2bf78c9b-04ae-4f82-b465-5dd55db100cc tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:50.148549 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-2bf78c9b-04ae-4f82-b465-5dd55db100cc tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.273589 Dec 20 09:28:50.151999 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 56/97] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:49 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:50.562314 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-101f0138-7b15-49ac-8a6a-b1085ba56ea8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:50.562314 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-101f0138-7b15-49ac-8a6a-b1085ba56ea8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:50.565096 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-101f0138-7b15-49ac-8a6a-b1085ba56ea8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:50.565620 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-101f0138-7b15-49ac-8a6a-b1085ba56ea8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:50.566729 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-101f0138-7b15-49ac-8a6a-b1085ba56ea8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:50.569828 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-101f0138-7b15-49ac-8a6a-b1085ba56ea8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:50.604634 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-80ae0798-5c34-4c38-abfd-34f106218b4c req-0968a776-1656-404f-98ae-367701724283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9ba0eda-fab4-44dc-b41f-0c51574dca1f", "tag": "b868aa5a-bfbe-4a31-ac51-6ef583b78b0e"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:28:50.606419 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:28:50.606419 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:28:50.613454 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-80ae0798-5c34-4c38-abfd-34f106218b4c req-0968a776-1656-404f-98ae-367701724283 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:50.613894 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-80ae0798-5c34-4c38-abfd-34f106218b4c req-0968a776-1656-404f-98ae-367701724283 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:50.633605 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-80ae0798-5c34-4c38-abfd-34f106218b4c req-0968a776-1656-404f-98ae-367701724283 service nova] Creating event network-changed:b868aa5a-bfbe-4a31-ac51-6ef583b78b0e for instance c9ba0eda-fab4-44dc-b41f-0c51574dca1f on hv-cinder-81908 Dec 20 09:28:50.647085 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-80ae0798-5c34-4c38-abfd-34f106218b4c req-0968a776-1656-404f-98ae-367701724283 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044365 Dec 20 09:28:50.647085 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 57/98] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:28:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:28:50.713298 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e712ccc4-b3ec-49db-8802-985e8b7c4728 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:50.713996 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e712ccc4-b3ec-49db-8802-985e8b7c4728 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:50.726616 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e712ccc4-b3ec-49db-8802-985e8b7c4728 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:50.727610 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e712ccc4-b3ec-49db-8802-985e8b7c4728 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:50.729135 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e712ccc4-b3ec-49db-8802-985e8b7c4728 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:50.729855 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e712ccc4-b3ec-49db-8802-985e8b7c4728 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:50.885379 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-101f0138-7b15-49ac-8a6a-b1085ba56ea8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:50.894300 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-101f0138-7b15-49ac-8a6a-b1085ba56ea8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:50.896059 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-101f0138-7b15-49ac-8a6a-b1085ba56ea8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:50.897775 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-101f0138-7b15-49ac-8a6a-b1085ba56ea8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1407 microversion: 2.20 time: 0.345088 Dec 20 09:28:50.899848 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 42/99] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:28:50 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1407 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:28:51.018920 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e712ccc4-b3ec-49db-8802-985e8b7c4728 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:51.030500 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e712ccc4-b3ec-49db-8802-985e8b7c4728 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.320770 Dec 20 09:28:51.031723 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 58/100] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:50 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:51.165272 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6c77669e-8452-4b4f-aee0-3b184920c3f1 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:51.165956 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6c77669e-8452-4b4f-aee0-3b184920c3f1 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:51.173601 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6c77669e-8452-4b4f-aee0-3b184920c3f1 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:51.175258 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6c77669e-8452-4b4f-aee0-3b184920c3f1 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:51.176379 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6c77669e-8452-4b4f-aee0-3b184920c3f1 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:51.177616 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6c77669e-8452-4b4f-aee0-3b184920c3f1 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:51.502742 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6c77669e-8452-4b4f-aee0-3b184920c3f1 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:51.521752 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6c77669e-8452-4b4f-aee0-3b184920c3f1 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.360691 Dec 20 09:28:51.526946 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 43/101] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:51 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:51.916489 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0e21353c-5de4-41fa-b465-c9b81b862e39 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:51.917099 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0e21353c-5de4-41fa-b465-c9b81b862e39 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:51.923182 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0e21353c-5de4-41fa-b465-c9b81b862e39 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:51.923643 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0e21353c-5de4-41fa-b465-c9b81b862e39 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:51.924466 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0e21353c-5de4-41fa-b465-c9b81b862e39 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:51.924906 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0e21353c-5de4-41fa-b465-c9b81b862e39 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:52.048929 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a265eb10-9ef3-447a-92e4-606c29faa04a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:52.049531 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a265eb10-9ef3-447a-92e4-606c29faa04a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:52.056676 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a265eb10-9ef3-447a-92e4-606c29faa04a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:52.057369 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a265eb10-9ef3-447a-92e4-606c29faa04a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:52.058405 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a265eb10-9ef3-447a-92e4-606c29faa04a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:52.058906 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a265eb10-9ef3-447a-92e4-606c29faa04a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:52.067266 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-0e21353c-5de4-41fa-b465-c9b81b862e39 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:52.076116 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-0e21353c-5de4-41fa-b465-c9b81b862e39 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:52.077611 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-0e21353c-5de4-41fa-b465-c9b81b862e39 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:52.078870 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0e21353c-5de4-41fa-b465-c9b81b862e39 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1407 microversion: 2.20 time: 0.166223 Dec 20 09:28:52.079421 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 59/102] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:28:51 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:28:52.212237 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a265eb10-9ef3-447a-92e4-606c29faa04a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:52.219453 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a265eb10-9ef3-447a-92e4-606c29faa04a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.175364 Dec 20 09:28:52.220387 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 44/103] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:52 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:52.541179 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8c47301d-70fe-4935-adf2-8798baa2eec2 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:52.541842 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-8c47301d-70fe-4935-adf2-8798baa2eec2 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:52.547976 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8c47301d-70fe-4935-adf2-8798baa2eec2 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:52.548420 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8c47301d-70fe-4935-adf2-8798baa2eec2 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:52.549200 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8c47301d-70fe-4935-adf2-8798baa2eec2 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:52.549630 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8c47301d-70fe-4935-adf2-8798baa2eec2 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:52.690722 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-8c47301d-70fe-4935-adf2-8798baa2eec2 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:52.710119 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8c47301d-70fe-4935-adf2-8798baa2eec2 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.162503 Dec 20 09:28:52.710119 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 60/104] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:52 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:53.096633 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-05c04da7-0997-443e-8f87-26a63c533151 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:53.097248 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-05c04da7-0997-443e-8f87-26a63c533151 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:53.104202 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-05c04da7-0997-443e-8f87-26a63c533151 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:53.104648 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-05c04da7-0997-443e-8f87-26a63c533151 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:53.105527 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-05c04da7-0997-443e-8f87-26a63c533151 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:53.105867 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-05c04da7-0997-443e-8f87-26a63c533151 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:53.235857 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-cf870d18-5a70-4a5f-96c0-c33b63659b46 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:53.237130 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-cf870d18-5a70-4a5f-96c0-c33b63659b46 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:53.245827 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cf870d18-5a70-4a5f-96c0-c33b63659b46 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:53.247686 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cf870d18-5a70-4a5f-96c0-c33b63659b46 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:53.251777 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cf870d18-5a70-4a5f-96c0-c33b63659b46 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:53.252461 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cf870d18-5a70-4a5f-96c0-c33b63659b46 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:53.293157 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-05c04da7-0997-443e-8f87-26a63c533151 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:53.303301 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-05c04da7-0997-443e-8f87-26a63c533151 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:53.313073 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-05c04da7-0997-443e-8f87-26a63c533151 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:53.314462 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-05c04da7-0997-443e-8f87-26a63c533151 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1407 microversion: 2.20 time: 0.221598 Dec 20 09:28:53.315587 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 45/105] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:28:53 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:28:53.430969 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-cf870d18-5a70-4a5f-96c0-c33b63659b46 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:53.441581 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-cf870d18-5a70-4a5f-96c0-c33b63659b46 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.209531 Dec 20 09:28:53.451612 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 61/106] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:53 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:28:53.717006 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-78774ee4-564f-499d-b07c-76f98c50087a tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:53.717766 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-78774ee4-564f-499d-b07c-76f98c50087a tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:53.723847 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-78774ee4-564f-499d-b07c-76f98c50087a tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:53.728467 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-78774ee4-564f-499d-b07c-76f98c50087a tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:53.728467 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-78774ee4-564f-499d-b07c-76f98c50087a tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:53.728467 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-78774ee4-564f-499d-b07c-76f98c50087a tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:53.881286 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-78774ee4-564f-499d-b07c-76f98c50087a tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:53.895277 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-78774ee4-564f-499d-b07c-76f98c50087a tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.175597 Dec 20 09:28:53.895277 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 46/107] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:53 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:28:54.334632 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d186d351-015c-46f1-a1b2-82f7913b3e28 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:54.334632 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d186d351-015c-46f1-a1b2-82f7913b3e28 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:54.341823 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d186d351-015c-46f1-a1b2-82f7913b3e28 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:54.342793 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d186d351-015c-46f1-a1b2-82f7913b3e28 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:54.343804 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d186d351-015c-46f1-a1b2-82f7913b3e28 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:54.344799 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d186d351-015c-46f1-a1b2-82f7913b3e28 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:54.460003 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f37a6b37-ca10-44c5-adda-5b0523b2246c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:54.461361 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f37a6b37-ca10-44c5-adda-5b0523b2246c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:54.471813 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f37a6b37-ca10-44c5-adda-5b0523b2246c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:54.473180 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f37a6b37-ca10-44c5-adda-5b0523b2246c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:54.477211 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f37a6b37-ca10-44c5-adda-5b0523b2246c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:54.477684 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f37a6b37-ca10-44c5-adda-5b0523b2246c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:54.576421 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d186d351-015c-46f1-a1b2-82f7913b3e28 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:54.585104 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d186d351-015c-46f1-a1b2-82f7913b3e28 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:54.587799 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d186d351-015c-46f1-a1b2-82f7913b3e28 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:54.589851 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d186d351-015c-46f1-a1b2-82f7913b3e28 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1407 microversion: 2.20 time: 0.260903 Dec 20 09:28:54.591101 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 62/108] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:28:54 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:28:54.682916 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f37a6b37-ca10-44c5-adda-5b0523b2246c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:54.698669 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f37a6b37-ca10-44c5-adda-5b0523b2246c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.243625 Dec 20 09:28:54.699933 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 47/109] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:54 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:54.908432 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-db232d6e-875d-43fd-904a-520fd928a8d2 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:54.908432 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-db232d6e-875d-43fd-904a-520fd928a8d2 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:54.912586 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-db232d6e-875d-43fd-904a-520fd928a8d2 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:54.913054 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-db232d6e-875d-43fd-904a-520fd928a8d2 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:54.913866 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-db232d6e-875d-43fd-904a-520fd928a8d2 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:54.914367 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-db232d6e-875d-43fd-904a-520fd928a8d2 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:55.052173 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-db232d6e-875d-43fd-904a-520fd928a8d2 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:55.060498 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-db232d6e-875d-43fd-904a-520fd928a8d2 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.158761 Dec 20 09:28:55.061288 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 63/110] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:54 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:55.607995 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-7a5569f6-cdf8-4059-a010-8ee49b03716b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:55.608606 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-7a5569f6-cdf8-4059-a010-8ee49b03716b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:55.615707 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7a5569f6-cdf8-4059-a010-8ee49b03716b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:55.616710 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7a5569f6-cdf8-4059-a010-8ee49b03716b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:55.618615 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7a5569f6-cdf8-4059-a010-8ee49b03716b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:55.619351 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7a5569f6-cdf8-4059-a010-8ee49b03716b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:55.716473 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-52b06abc-a140-400d-8d44-1f4ec0da95fe tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:55.717084 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-52b06abc-a140-400d-8d44-1f4ec0da95fe tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:55.723137 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-52b06abc-a140-400d-8d44-1f4ec0da95fe tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:55.723580 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-52b06abc-a140-400d-8d44-1f4ec0da95fe tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:55.724413 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-52b06abc-a140-400d-8d44-1f4ec0da95fe tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:55.727624 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-52b06abc-a140-400d-8d44-1f4ec0da95fe tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:55.770001 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-7a5569f6-cdf8-4059-a010-8ee49b03716b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:55.781347 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-7a5569f6-cdf8-4059-a010-8ee49b03716b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:55.782966 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-7a5569f6-cdf8-4059-a010-8ee49b03716b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:55.784909 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-7a5569f6-cdf8-4059-a010-8ee49b03716b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1407 microversion: 2.20 time: 0.180455 Dec 20 09:28:55.789498 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 48/111] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:28:55 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:28:55.884843 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-52b06abc-a140-400d-8d44-1f4ec0da95fe tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:55.892424 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-52b06abc-a140-400d-8d44-1f4ec0da95fe tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.180071 Dec 20 09:28:55.893007 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 64/112] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:55 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:56.077255 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-34c5b21e-84a4-4c11-aa13-57472dda9a6e tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:56.077997 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-34c5b21e-84a4-4c11-aa13-57472dda9a6e tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:56.084117 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-34c5b21e-84a4-4c11-aa13-57472dda9a6e tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:56.085708 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-34c5b21e-84a4-4c11-aa13-57472dda9a6e tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:56.085708 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-34c5b21e-84a4-4c11-aa13-57472dda9a6e tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:56.086586 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-34c5b21e-84a4-4c11-aa13-57472dda9a6e tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:56.249225 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-34c5b21e-84a4-4c11-aa13-57472dda9a6e tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:56.256847 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-34c5b21e-84a4-4c11-aa13-57472dda9a6e tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.183385 Dec 20 09:28:56.258316 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 49/113] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:56 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:56.805845 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a128ce19-c17e-44dc-a802-633b95ce1ea5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:56.807173 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a128ce19-c17e-44dc-a802-633b95ce1ea5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:56.813235 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a128ce19-c17e-44dc-a802-633b95ce1ea5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:56.813895 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a128ce19-c17e-44dc-a802-633b95ce1ea5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:56.814881 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a128ce19-c17e-44dc-a802-633b95ce1ea5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:56.815504 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a128ce19-c17e-44dc-a802-633b95ce1ea5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:56.909617 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d549135f-17c0-450b-b74b-43c7473c1f51 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:56.910797 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d549135f-17c0-450b-b74b-43c7473c1f51 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:56.917728 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d549135f-17c0-450b-b74b-43c7473c1f51 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:56.918175 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d549135f-17c0-450b-b74b-43c7473c1f51 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:56.919146 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d549135f-17c0-450b-b74b-43c7473c1f51 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:56.919583 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d549135f-17c0-450b-b74b-43c7473c1f51 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:56.966177 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a128ce19-c17e-44dc-a802-633b95ce1ea5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:56.974967 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a128ce19-c17e-44dc-a802-633b95ce1ea5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:56.983797 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a128ce19-c17e-44dc-a802-633b95ce1ea5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:56.983797 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a128ce19-c17e-44dc-a802-633b95ce1ea5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1407 microversion: 2.20 time: 0.176904 Dec 20 09:28:56.983797 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 65/114] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:28:56 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:28:57.069902 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d549135f-17c0-450b-b74b-43c7473c1f51 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:57.080823 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d549135f-17c0-450b-b74b-43c7473c1f51 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.174777 Dec 20 09:28:57.081764 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 50/115] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:56 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:28:57.277037 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-00c5bc93-8272-4154-bdbf-463e910f6e84 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:57.279719 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-00c5bc93-8272-4154-bdbf-463e910f6e84 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:57.283467 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-00c5bc93-8272-4154-bdbf-463e910f6e84 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:57.283973 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-00c5bc93-8272-4154-bdbf-463e910f6e84 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:57.284773 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-00c5bc93-8272-4154-bdbf-463e910f6e84 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:57.285212 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-00c5bc93-8272-4154-bdbf-463e910f6e84 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:57.454949 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-00c5bc93-8272-4154-bdbf-463e910f6e84 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:57.462730 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-00c5bc93-8272-4154-bdbf-463e910f6e84 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.192815 Dec 20 09:28:57.463498 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 66/116] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:57 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:57.996280 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-711a241e-ace7-4ce8-8093-da2ca012a1d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:57.996889 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-711a241e-ace7-4ce8-8093-da2ca012a1d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:58.002702 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-711a241e-ace7-4ce8-8093-da2ca012a1d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:58.003153 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-711a241e-ace7-4ce8-8093-da2ca012a1d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:58.004208 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-711a241e-ace7-4ce8-8093-da2ca012a1d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:58.004643 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-711a241e-ace7-4ce8-8093-da2ca012a1d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:58.097230 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-66fc5f56-5e1b-482f-b913-41b045921595 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:58.097841 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-66fc5f56-5e1b-482f-b913-41b045921595 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:58.105347 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-66fc5f56-5e1b-482f-b913-41b045921595 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:58.106196 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-66fc5f56-5e1b-482f-b913-41b045921595 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:58.107224 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-66fc5f56-5e1b-482f-b913-41b045921595 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:58.108110 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-66fc5f56-5e1b-482f-b913-41b045921595 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:58.181121 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-711a241e-ace7-4ce8-8093-da2ca012a1d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:58.192720 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-711a241e-ace7-4ce8-8093-da2ca012a1d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:58.194228 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-711a241e-ace7-4ce8-8093-da2ca012a1d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:58.195327 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-711a241e-ace7-4ce8-8093-da2ca012a1d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1407 microversion: 2.20 time: 0.203304 Dec 20 09:28:58.195918 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 51/117] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:28:57 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:28:58.250012 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-66fc5f56-5e1b-482f-b913-41b045921595 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:58.257543 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-66fc5f56-5e1b-482f-b913-41b045921595 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.164019 Dec 20 09:28:58.258114 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 67/118] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:58 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:58.478630 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8ea9e394-d702-4158-93ff-008edc6807ee tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:58.484936 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8ea9e394-d702-4158-93ff-008edc6807ee tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:58.485057 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8ea9e394-d702-4158-93ff-008edc6807ee tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:58.485474 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8ea9e394-d702-4158-93ff-008edc6807ee tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:58.486243 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8ea9e394-d702-4158-93ff-008edc6807ee tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:58.486679 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8ea9e394-d702-4158-93ff-008edc6807ee tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:58.698848 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8ea9e394-d702-4158-93ff-008edc6807ee tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:58.706020 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8ea9e394-d702-4158-93ff-008edc6807ee tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.230983 Dec 20 09:28:58.706588 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 52/119] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:58 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:28:59.177482 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-442b03c7-69fd-4ace-9463-2bd6482ee0df req-0a868b92-4062-46a1-9c6e-07499608673b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb93a254-d6ca-433b-8317-d0a21f49cdf9", "name": "network-vif-plugged", "status": "completed", "tag": "87d44c65-d907-4b8c-b972-32c1d837d695"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:28:59.179300 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:28:59.179300 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:28:59.186968 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-442b03c7-69fd-4ace-9463-2bd6482ee0df req-0a868b92-4062-46a1-9c6e-07499608673b service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:59.191748 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-442b03c7-69fd-4ace-9463-2bd6482ee0df req-0a868b92-4062-46a1-9c6e-07499608673b service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:59.198855 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-442b03c7-69fd-4ace-9463-2bd6482ee0df req-0a868b92-4062-46a1-9c6e-07499608673b service nova] Creating event network-vif-plugged:87d44c65-d907-4b8c-b972-32c1d837d695 for instance eb93a254-d6ca-433b-8317-d0a21f49cdf9 on hv-cinder-81908 Dec 20 09:28:59.203497 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-442b03c7-69fd-4ace-9463-2bd6482ee0df req-0a868b92-4062-46a1-9c6e-07499608673b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089702 Dec 20 09:28:59.204448 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 68/120] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:28:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:28:59.213225 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8c001031-c8dc-44db-b1f8-114101ef46d7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:59.213916 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8c001031-c8dc-44db-b1f8-114101ef46d7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:59.222370 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8c001031-c8dc-44db-b1f8-114101ef46d7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:59.222370 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8c001031-c8dc-44db-b1f8-114101ef46d7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:59.222370 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8c001031-c8dc-44db-b1f8-114101ef46d7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:59.222910 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8c001031-c8dc-44db-b1f8-114101ef46d7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:59.274845 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-933d250e-5602-4c2e-90bd-26e80f356882 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:59.275665 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-933d250e-5602-4c2e-90bd-26e80f356882 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:59.281953 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-933d250e-5602-4c2e-90bd-26e80f356882 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:59.282479 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-933d250e-5602-4c2e-90bd-26e80f356882 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:59.283270 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-933d250e-5602-4c2e-90bd-26e80f356882 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:59.283729 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-933d250e-5602-4c2e-90bd-26e80f356882 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:59.465029 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8c001031-c8dc-44db-b1f8-114101ef46d7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:59.472859 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8c001031-c8dc-44db-b1f8-114101ef46d7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:59.474431 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8c001031-c8dc-44db-b1f8-114101ef46d7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:59.475629 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8c001031-c8dc-44db-b1f8-114101ef46d7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1407 microversion: 2.20 time: 0.266398 Dec 20 09:28:59.476333 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 53/121] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:28:59 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:28:59.545262 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-933d250e-5602-4c2e-90bd-26e80f356882 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:59.553861 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-933d250e-5602-4c2e-90bd-26e80f356882 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.283483 Dec 20 09:28:59.554443 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 69/122] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:59 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:28:59.725212 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e6246ef7-d026-4a98-b556-1c723098048a tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:28:59.725755 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e6246ef7-d026-4a98-b556-1c723098048a tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:28:59.731556 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e6246ef7-d026-4a98-b556-1c723098048a tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:59.732039 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e6246ef7-d026-4a98-b556-1c723098048a tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:59.732919 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e6246ef7-d026-4a98-b556-1c723098048a tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:28:59.733285 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e6246ef7-d026-4a98-b556-1c723098048a tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:28:59.871262 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e6246ef7-d026-4a98-b556-1c723098048a tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:28:59.879370 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e6246ef7-d026-4a98-b556-1c723098048a tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.157531 Dec 20 09:28:59.882161 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 54/123] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:28:59 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:00.494301 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7fc07bf7-a34c-4ec4-8187-0be36c1e7e48 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:00.494922 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7fc07bf7-a34c-4ec4-8187-0be36c1e7e48 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:00.500998 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7fc07bf7-a34c-4ec4-8187-0be36c1e7e48 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:00.501452 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7fc07bf7-a34c-4ec4-8187-0be36c1e7e48 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:00.502482 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7fc07bf7-a34c-4ec4-8187-0be36c1e7e48 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:00.502930 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7fc07bf7-a34c-4ec4-8187-0be36c1e7e48 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:00.572570 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1b2cbe2a-400b-460f-bca2-9dcb0b534212 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:00.575042 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1b2cbe2a-400b-460f-bca2-9dcb0b534212 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:00.583811 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1b2cbe2a-400b-460f-bca2-9dcb0b534212 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:00.584562 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1b2cbe2a-400b-460f-bca2-9dcb0b534212 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:00.585578 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1b2cbe2a-400b-460f-bca2-9dcb0b534212 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:00.586399 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1b2cbe2a-400b-460f-bca2-9dcb0b534212 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:00.693085 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7fc07bf7-a34c-4ec4-8187-0be36c1e7e48 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:00.700891 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7fc07bf7-a34c-4ec4-8187-0be36c1e7e48 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:00.703937 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7fc07bf7-a34c-4ec4-8187-0be36c1e7e48 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:00.703937 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7fc07bf7-a34c-4ec4-8187-0be36c1e7e48 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1407 microversion: 2.20 time: 0.213576 Dec 20 09:29:00.704374 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 70/124] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:29:00 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:29:00.788079 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1b2cbe2a-400b-460f-bca2-9dcb0b534212 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:00.795733 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1b2cbe2a-400b-460f-bca2-9dcb0b534212 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.228673 Dec 20 09:29:00.796297 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 55/125] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:00 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:00.899464 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-2c77abfa-0815-4746-ab37-ec9c4fada9b9 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:00.899464 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-2c77abfa-0815-4746-ab37-ec9c4fada9b9 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:00.904275 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2c77abfa-0815-4746-ab37-ec9c4fada9b9 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:00.904854 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2c77abfa-0815-4746-ab37-ec9c4fada9b9 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:00.905711 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2c77abfa-0815-4746-ab37-ec9c4fada9b9 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:00.906151 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2c77abfa-0815-4746-ab37-ec9c4fada9b9 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:01.043302 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-2c77abfa-0815-4746-ab37-ec9c4fada9b9 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:01.050467 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-2c77abfa-0815-4746-ab37-ec9c4fada9b9 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.157925 Dec 20 09:29:01.051042 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 71/126] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:00 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:01.219628 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-d5a81b3b-bc80-47b6-a473-e44f0938f1bf req-9f1ac5a7-b761-4bd4-a29c-3f4042e30215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af8e934-5860-485f-abf5-42a2814d66e7", "name": "network-vif-plugged", "status": "completed", "tag": "400b05c3-3434-415b-b982-6014d3a882ac"}, {"server_uuid": "632d2ff5-8fa8-4c1f-8bf0-de64b20de339", "name": "network-vif-plugged", "status": "completed", "tag": "ab78a4d5-9785-4d8f-a076-dcb2076e8cb1"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:01.221824 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:29:01.221824 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:29:01.229638 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-d5a81b3b-bc80-47b6-a473-e44f0938f1bf req-9f1ac5a7-b761-4bd4-a29c-3f4042e30215 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:01.230082 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-d5a81b3b-bc80-47b6-a473-e44f0938f1bf req-9f1ac5a7-b761-4bd4-a29c-3f4042e30215 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:01.242374 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-d5a81b3b-bc80-47b6-a473-e44f0938f1bf req-9f1ac5a7-b761-4bd4-a29c-3f4042e30215 service nova] Creating event network-vif-plugged:400b05c3-3434-415b-b982-6014d3a882ac for instance 1af8e934-5860-485f-abf5-42a2814d66e7 on hv-cinder-81908 Dec 20 09:29:01.243383 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-d5a81b3b-bc80-47b6-a473-e44f0938f1bf req-9f1ac5a7-b761-4bd4-a29c-3f4042e30215 service nova] Creating event network-vif-plugged:ab78a4d5-9785-4d8f-a076-dcb2076e8cb1 for instance 632d2ff5-8fa8-4c1f-8bf0-de64b20de339 on hv-cinder-81908 Dec 20 09:29:01.250124 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-d5a81b3b-bc80-47b6-a473-e44f0938f1bf req-9f1ac5a7-b761-4bd4-a29c-3f4042e30215 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034942 Dec 20 09:29:01.251001 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 56/127] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:29:01 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:29:01.721360 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b3d71fbe-06b1-458b-8168-91b29813496b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:01.721975 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b3d71fbe-06b1-458b-8168-91b29813496b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:01.728139 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b3d71fbe-06b1-458b-8168-91b29813496b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:01.728592 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b3d71fbe-06b1-458b-8168-91b29813496b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:01.729382 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b3d71fbe-06b1-458b-8168-91b29813496b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:01.729823 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b3d71fbe-06b1-458b-8168-91b29813496b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:01.816828 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-fbc0bac7-2fb2-47eb-b85d-1fd98cc661d4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:01.817531 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-fbc0bac7-2fb2-47eb-b85d-1fd98cc661d4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:01.824235 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fbc0bac7-2fb2-47eb-b85d-1fd98cc661d4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:01.830870 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fbc0bac7-2fb2-47eb-b85d-1fd98cc661d4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:01.830870 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fbc0bac7-2fb2-47eb-b85d-1fd98cc661d4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:01.830870 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fbc0bac7-2fb2-47eb-b85d-1fd98cc661d4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:01.879117 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b3d71fbe-06b1-458b-8168-91b29813496b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:01.887558 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b3d71fbe-06b1-458b-8168-91b29813496b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:01.889077 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b3d71fbe-06b1-458b-8168-91b29813496b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:01.890174 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b3d71fbe-06b1-458b-8168-91b29813496b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1407 microversion: 2.20 time: 0.172942 Dec 20 09:29:01.890731 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 72/128] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:29:01 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:29:01.973407 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-fbc0bac7-2fb2-47eb-b85d-1fd98cc661d4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:01.981368 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-fbc0bac7-2fb2-47eb-b85d-1fd98cc661d4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.168173 Dec 20 09:29:01.985957 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 57/129] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:01 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:02.067112 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d1af72aa-8720-4014-ad09-45e06581aa11 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:02.067901 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d1af72aa-8720-4014-ad09-45e06581aa11 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:02.074801 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d1af72aa-8720-4014-ad09-45e06581aa11 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:02.075275 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d1af72aa-8720-4014-ad09-45e06581aa11 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:02.076106 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d1af72aa-8720-4014-ad09-45e06581aa11 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:02.076547 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d1af72aa-8720-4014-ad09-45e06581aa11 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:02.205230 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d1af72aa-8720-4014-ad09-45e06581aa11 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:02.212549 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d1af72aa-8720-4014-ad09-45e06581aa11 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.149561 Dec 20 09:29:02.213123 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 73/130] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:02 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:02.907889 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-61b88963-bd5c-473a-9bcd-aa46db3ceb37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:02.908492 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-61b88963-bd5c-473a-9bcd-aa46db3ceb37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:02.914433 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-61b88963-bd5c-473a-9bcd-aa46db3ceb37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:02.915379 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-61b88963-bd5c-473a-9bcd-aa46db3ceb37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:02.916239 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-61b88963-bd5c-473a-9bcd-aa46db3ceb37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:02.916673 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-61b88963-bd5c-473a-9bcd-aa46db3ceb37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:02.996827 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-2f7ed121-95d4-4603-96ae-b9a250f35856 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:02.997443 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-2f7ed121-95d4-4603-96ae-b9a250f35856 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:03.003362 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2f7ed121-95d4-4603-96ae-b9a250f35856 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:03.004348 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2f7ed121-95d4-4603-96ae-b9a250f35856 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:03.005151 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2f7ed121-95d4-4603-96ae-b9a250f35856 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:03.005590 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2f7ed121-95d4-4603-96ae-b9a250f35856 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:03.101014 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-61b88963-bd5c-473a-9bcd-aa46db3ceb37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:03.108839 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-61b88963-bd5c-473a-9bcd-aa46db3ceb37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:03.110573 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-61b88963-bd5c-473a-9bcd-aa46db3ceb37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:03.111719 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-61b88963-bd5c-473a-9bcd-aa46db3ceb37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1407 microversion: 2.20 time: 0.207630 Dec 20 09:29:03.121910 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 58/131] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:29:02 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:29:03.176626 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-2f7ed121-95d4-4603-96ae-b9a250f35856 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:03.184876 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-2f7ed121-95d4-4603-96ae-b9a250f35856 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.191660 Dec 20 09:29:03.186185 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 74/132] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:02 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:03.229536 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c34bf3a4-b0e3-4cb7-a132-33724e315686 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:03.230083 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c34bf3a4-b0e3-4cb7-a132-33724e315686 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:03.235950 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c34bf3a4-b0e3-4cb7-a132-33724e315686 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:03.236390 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c34bf3a4-b0e3-4cb7-a132-33724e315686 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:03.237146 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c34bf3a4-b0e3-4cb7-a132-33724e315686 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:03.237577 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c34bf3a4-b0e3-4cb7-a132-33724e315686 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:03.390934 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-c34bf3a4-b0e3-4cb7-a132-33724e315686 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:03.412756 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c34bf3a4-b0e3-4cb7-a132-33724e315686 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.186877 Dec 20 09:29:03.416510 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 59/133] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:03 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:03.876001 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-8bdebcb8-ed93-4ded-8e25-8b85e674fd54 req-4050d4c3-7bf5-4b4f-8e23-33e6ee7c9ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9ba0eda-fab4-44dc-b41f-0c51574dca1f", "name": "network-vif-plugged", "status": "completed", "tag": "b868aa5a-bfbe-4a31-ac51-6ef583b78b0e"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:03.877623 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:29:03.877623 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:29:03.885343 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-8bdebcb8-ed93-4ded-8e25-8b85e674fd54 req-4050d4c3-7bf5-4b4f-8e23-33e6ee7c9ea4 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:03.885787 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-8bdebcb8-ed93-4ded-8e25-8b85e674fd54 req-4050d4c3-7bf5-4b4f-8e23-33e6ee7c9ea4 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:03.896448 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-8bdebcb8-ed93-4ded-8e25-8b85e674fd54 req-4050d4c3-7bf5-4b4f-8e23-33e6ee7c9ea4 service nova] Creating event network-vif-plugged:b868aa5a-bfbe-4a31-ac51-6ef583b78b0e for instance c9ba0eda-fab4-44dc-b41f-0c51574dca1f on hv-cinder-81908 Dec 20 09:29:03.902035 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-8bdebcb8-ed93-4ded-8e25-8b85e674fd54 req-4050d4c3-7bf5-4b4f-8e23-33e6ee7c9ea4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030066 Dec 20 09:29:03.902780 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 75/134] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:29:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:29:04.082247 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-3c75d9f5-3cf0-4a26-935e-61bde803c385 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1144002485", "imageRef": "6f828f0b-c445-46a5-9960-492746785ef3", "flavorRef": "452", "networks": [{"uuid": "822cd373-b73e-4a6a-9b6d-45ec265552d1"}]}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:04.136557 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e940db46-66d4-45d6-87e4-3f13d36c13ba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:04.136557 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e940db46-66d4-45d6-87e4-3f13d36c13ba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:04.137084 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.network.neutron [None req-3c75d9f5-3cf0-4a26-935e-61bde803c385 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] validate_networks() for [('822cd373-b73e-4a6a-9b6d-45ec265552d1', None, None, None, None, None)] {{(pid=116675) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 09:29:04.138223 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e940db46-66d4-45d6-87e4-3f13d36c13ba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:04.138694 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e940db46-66d4-45d6-87e4-3f13d36c13ba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:04.139762 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e940db46-66d4-45d6-87e4-3f13d36c13ba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:04.140355 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e940db46-66d4-45d6-87e4-3f13d36c13ba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:04.372508 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e940db46-66d4-45d6-87e4-3f13d36c13ba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:04.382440 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e940db46-66d4-45d6-87e4-3f13d36c13ba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:04.384674 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e940db46-66d4-45d6-87e4-3f13d36c13ba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:04.385853 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e940db46-66d4-45d6-87e4-3f13d36c13ba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1407 microversion: 2.20 time: 0.260375 Dec 20 09:29:04.386408 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 76/135] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:29:04 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:29:04.392779 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9eb16056-39bc-4e61-af62-0b0132496703 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:04.397833 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9eb16056-39bc-4e61-af62-0b0132496703 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:04.404864 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9eb16056-39bc-4e61-af62-0b0132496703 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:04.406230 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9eb16056-39bc-4e61-af62-0b0132496703 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:04.407055 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9eb16056-39bc-4e61-af62-0b0132496703 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:04.407502 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9eb16056-39bc-4e61-af62-0b0132496703 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:04.635643 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-9eb16056-39bc-4e61-af62-0b0132496703 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:04.638006 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-3c75d9f5-3cf0-4a26-935e-61bde803c385 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Flavor limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 09:29:04.638688 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-3c75d9f5-3cf0-4a26-935e-61bde803c385 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Image limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 09:29:04.639219 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-3c75d9f5-3cf0-4a26-935e-61bde803c385 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Flavor pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 09:29:04.640032 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-3c75d9f5-3cf0-4a26-935e-61bde803c385 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Image pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 09:29:04.640503 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-3c75d9f5-3cf0-4a26-935e-61bde803c385 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 09:29:04.643720 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9eb16056-39bc-4e61-af62-0b0132496703 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1321 microversion: 2.1 time: 0.255540 Dec 20 09:29:04.644307 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 77/136] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:04 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:04.648915 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-63313e2a-6bc5-42b8-b65b-844d85855cde tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:04.650275 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-63313e2a-6bc5-42b8-b65b-844d85855cde tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:04.650391 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3c75d9f5-3cf0-4a26-935e-61bde803c385 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:04.650821 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3c75d9f5-3cf0-4a26-935e-61bde803c385 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:04.651719 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3c75d9f5-3cf0-4a26-935e-61bde803c385 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:04.652359 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3c75d9f5-3cf0-4a26-935e-61bde803c385 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:04.656055 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-63313e2a-6bc5-42b8-b65b-844d85855cde tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:04.659328 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-63313e2a-6bc5-42b8-b65b-844d85855cde tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:04.659328 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-63313e2a-6bc5-42b8-b65b-844d85855cde tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:04.659328 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-63313e2a-6bc5-42b8-b65b-844d85855cde tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:04.673880 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-3c75d9f5-3cf0-4a26-935e-61bde803c385 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Getting quotas for project c49197c6143140908f9feb71ef03ce54. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:29:04.678145 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-3c75d9f5-3cf0-4a26-935e-61bde803c385 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Getting quotas for user 3b6621c6ec264cad9fe24e1dcfe49ee1 and project c49197c6143140908f9feb71ef03ce54. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:29:04.690145 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-3c75d9f5-3cf0-4a26-935e-61bde803c385 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Going to run 1 instances... {{(pid=116675) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 09:29:04.692574 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-3c75d9f5-3cf0-4a26-935e-61bde803c385 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f828f0b-c445-46a5-9960-492746785ef3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 09:29:04.807886 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-63313e2a-6bc5-42b8-b65b-844d85855cde tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:04.819252 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-63313e2a-6bc5-42b8-b65b-844d85855cde tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1314 microversion: 2.1 time: 0.173550 Dec 20 09:29:04.820078 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 78/137] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:04 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:04.869625 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-3c75d9f5-3cf0-4a26-935e-61bde803c385 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791730 Dec 20 09:29:04.871204 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 60/138] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 20 09:29:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 09:29:04.880598 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-14afc284-5774-49af-be51-28ba1b06aa87 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:04.881343 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-14afc284-5774-49af-be51-28ba1b06aa87 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:04.946686 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-14afc284-5774-49af-be51-28ba1b06aa87 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:04.958625 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-14afc284-5774-49af-be51-28ba1b06aa87 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1214 microversion: 2.1 time: 0.081880 Dec 20 09:29:04.959804 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 79/139] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:04 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:05.403896 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6b14c765-87d7-4084-95f7-241c83add7d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:05.404691 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6b14c765-87d7-4084-95f7-241c83add7d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:05.411744 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6b14c765-87d7-4084-95f7-241c83add7d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:05.413802 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6b14c765-87d7-4084-95f7-241c83add7d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:05.415273 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6b14c765-87d7-4084-95f7-241c83add7d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:05.415753 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6b14c765-87d7-4084-95f7-241c83add7d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:05.563055 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6b14c765-87d7-4084-95f7-241c83add7d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:05.571783 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6b14c765-87d7-4084-95f7-241c83add7d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:05.573308 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6b14c765-87d7-4084-95f7-241c83add7d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:05.574402 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6b14c765-87d7-4084-95f7-241c83add7d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1407 microversion: 2.20 time: 0.174372 Dec 20 09:29:05.574950 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 61/140] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:29:05 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:29:05.661510 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e7173147-f106-41e0-9112-bda4be870b66 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:05.662061 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e7173147-f106-41e0-9112-bda4be870b66 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:05.668727 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e7173147-f106-41e0-9112-bda4be870b66 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:05.669175 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e7173147-f106-41e0-9112-bda4be870b66 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:05.670005 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e7173147-f106-41e0-9112-bda4be870b66 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:05.670756 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e7173147-f106-41e0-9112-bda4be870b66 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:05.809962 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e7173147-f106-41e0-9112-bda4be870b66 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:05.817330 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e7173147-f106-41e0-9112-bda4be870b66 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1516 microversion: 2.1 time: 0.159984 Dec 20 09:29:05.817907 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 80/141] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:05 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:05.834144 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-3c5233a8-612f-41b9-b268-e89e284b1fad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:05.835134 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-3c5233a8-612f-41b9-b268-e89e284b1fad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:05.837395 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-bec2f240-f421-4f4d-b1be-84456b040609 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:05.838051 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-bec2f240-f421-4f4d-b1be-84456b040609 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:05.843092 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3c5233a8-612f-41b9-b268-e89e284b1fad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:05.844827 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3c5233a8-612f-41b9-b268-e89e284b1fad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:05.844943 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bec2f240-f421-4f4d-b1be-84456b040609 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:05.845032 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3c5233a8-612f-41b9-b268-e89e284b1fad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:05.845109 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bec2f240-f421-4f4d-b1be-84456b040609 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:05.845178 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3c5233a8-612f-41b9-b268-e89e284b1fad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:05.845262 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bec2f240-f421-4f4d-b1be-84456b040609 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:05.845587 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bec2f240-f421-4f4d-b1be-84456b040609 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:05.906636 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.objects.instance [None req-3c5233a8-612f-41b9-b268-e89e284b1fad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lazy-loading 'flavor' on Instance uuid eb93a254-d6ca-433b-8317-d0a21f49cdf9 {{(pid=116675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:29:06.025149 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-bec2f240-f421-4f4d-b1be-84456b040609 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:06.037483 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-bec2f240-f421-4f4d-b1be-84456b040609 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1501 microversion: 2.1 time: 0.204727 Dec 20 09:29:06.039766 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 81/142] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:05 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1501 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:06.042568 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-22728a16-6cf0-495b-861c-952f172a604a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:06.043165 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-22728a16-6cf0-495b-861c-952f172a604a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:06.049121 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-22728a16-6cf0-495b-861c-952f172a604a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:06.049567 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-22728a16-6cf0-495b-861c-952f172a604a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:06.050359 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-22728a16-6cf0-495b-861c-952f172a604a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:06.050795 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-22728a16-6cf0-495b-861c-952f172a604a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:06.115108 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-22728a16-6cf0-495b-861c-952f172a604a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:06.124592 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-22728a16-6cf0-495b-861c-952f172a604a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1218 microversion: 2.1 time: 0.085329 Dec 20 09:29:06.125175 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 82/143] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:06 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:06.355267 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-3c5233a8-612f-41b9-b268-e89e284b1fad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "POST /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9/action" status: 200 len: 32 microversion: 2.1 time: 0.524853 Dec 20 09:29:06.356159 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 62/144] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:29:05 2021] POST /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9/action => generated 32 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 09:29:06.366104 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c70fff4c-6b57-4162-8be8-8d7f9eb64f7a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:06.367266 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c70fff4c-6b57-4162-8be8-8d7f9eb64f7a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:06.374185 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c70fff4c-6b57-4162-8be8-8d7f9eb64f7a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:06.374712 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c70fff4c-6b57-4162-8be8-8d7f9eb64f7a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:06.375578 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c70fff4c-6b57-4162-8be8-8d7f9eb64f7a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:06.376269 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c70fff4c-6b57-4162-8be8-8d7f9eb64f7a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:06.593753 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c9edaece-3cd1-40d0-a141-c7d73fde472c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:06.594322 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c9edaece-3cd1-40d0-a141-c7d73fde472c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:06.620380 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9edaece-3cd1-40d0-a141-c7d73fde472c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:06.620829 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9edaece-3cd1-40d0-a141-c7d73fde472c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:06.625600 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9edaece-3cd1-40d0-a141-c7d73fde472c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:06.625600 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9edaece-3cd1-40d0-a141-c7d73fde472c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:06.870604 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-c70fff4c-6b57-4162-8be8-8d7f9eb64f7a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:06.877908 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c70fff4c-6b57-4162-8be8-8d7f9eb64f7a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.516449 Dec 20 09:29:06.879069 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 83/145] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:06 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:06.883386 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-c9edaece-3cd1-40d0-a141-c7d73fde472c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:06.892557 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-c9edaece-3cd1-40d0-a141-c7d73fde472c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:06.894045 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-c9edaece-3cd1-40d0-a141-c7d73fde472c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:06.895265 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c9edaece-3cd1-40d0-a141-c7d73fde472c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1598 microversion: 2.20 time: 0.306252 Dec 20 09:29:06.895874 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 63/146] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:29:06 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1598 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:29:06.912938 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-87c17239-6f68-4f2c-bed0-49e8b32eaace tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:06.913439 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-87c17239-6f68-4f2c-bed0-49e8b32eaace tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:06.920191 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-87c17239-6f68-4f2c-bed0-49e8b32eaace tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:06.920645 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-87c17239-6f68-4f2c-bed0-49e8b32eaace tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:06.921467 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-87c17239-6f68-4f2c-bed0-49e8b32eaace tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:06.922047 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-87c17239-6f68-4f2c-bed0-49e8b32eaace tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:07.099497 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-87c17239-6f68-4f2c-bed0-49e8b32eaace tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.190364 Dec 20 09:29:07.100146 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 84/147] 10.222.0.62 () {60 vars in 1315 bytes} [Mon Dec 20 09:29:06 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/os-interface => generated 284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:29:07.146432 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-aa4aea28-4fb5-48c4-9037-a29503f822d5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:07.152954 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-aa4aea28-4fb5-48c4-9037-a29503f822d5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:07.160257 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-aa4aea28-4fb5-48c4-9037-a29503f822d5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:07.160717 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-aa4aea28-4fb5-48c4-9037-a29503f822d5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:07.172267 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-aa4aea28-4fb5-48c4-9037-a29503f822d5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:07.174268 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-aa4aea28-4fb5-48c4-9037-a29503f822d5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:07.252042 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-aa4aea28-4fb5-48c4-9037-a29503f822d5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:07.267392 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-aa4aea28-4fb5-48c4-9037-a29503f822d5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1266 microversion: 2.1 time: 0.127447 Dec 20 09:29:07.279807 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 64/148] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:07 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:07.894744 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8f478676-3cc4-42ca-8dd5-55e64aaed26e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:07.895359 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-8f478676-3cc4-42ca-8dd5-55e64aaed26e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:07.901848 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8f478676-3cc4-42ca-8dd5-55e64aaed26e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:07.902233 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8f478676-3cc4-42ca-8dd5-55e64aaed26e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:07.903323 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8f478676-3cc4-42ca-8dd5-55e64aaed26e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:07.903785 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8f478676-3cc4-42ca-8dd5-55e64aaed26e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:08.199221 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-25b0304d-f91c-403c-a97b-a5a612bd00d7 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f23d63d-d1e0-4553-8cec-1a7de56985c1"}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:08.200346 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-25b0304d-f91c-403c-a97b-a5a612bd00d7 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:08.205416 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-8f478676-3cc4-42ca-8dd5-55e64aaed26e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:08.209200 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-25b0304d-f91c-403c-a97b-a5a612bd00d7 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:08.210511 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-25b0304d-f91c-403c-a97b-a5a612bd00d7 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:08.212417 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-25b0304d-f91c-403c-a97b-a5a612bd00d7 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:08.213670 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-25b0304d-f91c-403c-a97b-a5a612bd00d7 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:08.223198 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8f478676-3cc4-42ca-8dd5-55e64aaed26e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.332689 Dec 20 09:29:08.226661 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 85/149] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:07 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:08.287650 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-548977f3-9cd2-4bb0-b08e-ce25e8500dce tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:08.288331 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-548977f3-9cd2-4bb0-b08e-ce25e8500dce tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:08.298806 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-548977f3-9cd2-4bb0-b08e-ce25e8500dce tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:08.301815 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-548977f3-9cd2-4bb0-b08e-ce25e8500dce tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:08.303536 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-548977f3-9cd2-4bb0-b08e-ce25e8500dce tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:08.307077 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-548977f3-9cd2-4bb0-b08e-ce25e8500dce tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:08.382540 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-548977f3-9cd2-4bb0-b08e-ce25e8500dce tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:08.390933 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-548977f3-9cd2-4bb0-b08e-ce25e8500dce tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1272 microversion: 2.1 time: 0.108903 Dec 20 09:29:08.392482 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 86/150] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:08 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1272 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:08.915690 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ac306689-4353-4ece-9d97-fdf9e676fc92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:08.917022 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ac306689-4353-4ece-9d97-fdf9e676fc92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:08.929261 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac306689-4353-4ece-9d97-fdf9e676fc92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:08.930302 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac306689-4353-4ece-9d97-fdf9e676fc92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:08.931341 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac306689-4353-4ece-9d97-fdf9e676fc92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:08.932656 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac306689-4353-4ece-9d97-fdf9e676fc92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:09.030556 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ac306689-4353-4ece-9d97-fdf9e676fc92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 14 microversion: 2.20 time: 0.118555 Dec 20 09:29:09.031286 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 87/151] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:08 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:09.037668 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-077adff4-5149-4091-9530-24a1cd9515ff req-42beeb18-7799-4d78-b166-39aa299ae89c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9ba0eda-fab4-44dc-b41f-0c51574dca1f", "tag": "b868aa5a-bfbe-4a31-ac51-6ef583b78b0e"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:09.040034 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:29:09.040034 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:29:09.069623 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-077adff4-5149-4091-9530-24a1cd9515ff req-42beeb18-7799-4d78-b166-39aa299ae89c service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:09.070464 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-077adff4-5149-4091-9530-24a1cd9515ff req-42beeb18-7799-4d78-b166-39aa299ae89c service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:09.102819 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-077adff4-5149-4091-9530-24a1cd9515ff req-42beeb18-7799-4d78-b166-39aa299ae89c service nova] Creating event network-changed:b868aa5a-bfbe-4a31-ac51-6ef583b78b0e for instance c9ba0eda-fab4-44dc-b41f-0c51574dca1f on hv-cinder-81908 Dec 20 09:29:09.124289 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-077adff4-5149-4091-9530-24a1cd9515ff req-42beeb18-7799-4d78-b166-39aa299ae89c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091296 Dec 20 09:29:09.128379 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 88/152] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:29:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:29:09.250693 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ff6fcdf0-5d89-4add-b017-7c3c86b96740 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:09.251773 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ff6fcdf0-5d89-4add-b017-7c3c86b96740 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:09.259926 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ff6fcdf0-5d89-4add-b017-7c3c86b96740 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:09.260735 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ff6fcdf0-5d89-4add-b017-7c3c86b96740 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:09.261578 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ff6fcdf0-5d89-4add-b017-7c3c86b96740 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:09.262229 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ff6fcdf0-5d89-4add-b017-7c3c86b96740 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:09.334990 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-25b0304d-f91c-403c-a97b-a5a612bd00d7 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "POST /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.140730 Dec 20 09:29:09.336419 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 65/153] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 20 09:29:08 2021] POST /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339/os-volume_attachments => generated 194 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:29:09.411373 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-977c3ffe-5d55-4a11-b006-9b7186caf43a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:09.412881 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-977c3ffe-5d55-4a11-b006-9b7186caf43a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:09.424265 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-977c3ffe-5d55-4a11-b006-9b7186caf43a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:09.426912 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-977c3ffe-5d55-4a11-b006-9b7186caf43a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:09.429606 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-977c3ffe-5d55-4a11-b006-9b7186caf43a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:09.432955 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-977c3ffe-5d55-4a11-b006-9b7186caf43a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:09.544108 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ff6fcdf0-5d89-4add-b017-7c3c86b96740 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:09.558539 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ff6fcdf0-5d89-4add-b017-7c3c86b96740 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.311175 Dec 20 09:29:09.561005 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 89/154] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:09 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:09.713664 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-977c3ffe-5d55-4a11-b006-9b7186caf43a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:09.721602 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-977c3ffe-5d55-4a11-b006-9b7186caf43a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.314894 Dec 20 09:29:09.726254 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 66/155] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:09 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:10.046735 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-50ea164d-99b1-4354-afef-f61717afbcba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:10.047930 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-50ea164d-99b1-4354-afef-f61717afbcba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:10.056739 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-50ea164d-99b1-4354-afef-f61717afbcba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:10.058549 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-50ea164d-99b1-4354-afef-f61717afbcba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:10.061354 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-50ea164d-99b1-4354-afef-f61717afbcba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:10.068356 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-50ea164d-99b1-4354-afef-f61717afbcba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:10.140819 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-50ea164d-99b1-4354-afef-f61717afbcba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 14 microversion: 2.20 time: 0.101637 Dec 20 09:29:10.141712 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 90/156] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:10 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:10.507029 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-9817bc44-6d4b-4cf8-b13f-a41b77c5ab92 req-a3ef57e9-ad63-43b4-99bd-eaa6bcc2c0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d4cec5f-091a-4dbf-8e38-aafb2b24f957", "tag": "28297062-13cd-4a98-b825-64eed343639e"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:10.509677 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:29:10.509677 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:29:10.521946 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-9817bc44-6d4b-4cf8-b13f-a41b77c5ab92 req-a3ef57e9-ad63-43b4-99bd-eaa6bcc2c0c1 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:10.526190 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-9817bc44-6d4b-4cf8-b13f-a41b77c5ab92 req-a3ef57e9-ad63-43b4-99bd-eaa6bcc2c0c1 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:10.547325 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-9817bc44-6d4b-4cf8-b13f-a41b77c5ab92 req-a3ef57e9-ad63-43b4-99bd-eaa6bcc2c0c1 service nova] Creating event network-changed:28297062-13cd-4a98-b825-64eed343639e for instance 5d4cec5f-091a-4dbf-8e38-aafb2b24f957 on hv-cinder-81908 Dec 20 09:29:10.564970 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-9817bc44-6d4b-4cf8-b13f-a41b77c5ab92 req-a3ef57e9-ad63-43b4-99bd-eaa6bcc2c0c1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064897 Dec 20 09:29:10.565944 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 67/157] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:29:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:29:10.578121 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-940d25e8-011c-4af9-9ddb-8b9c1a44a06a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:10.579108 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-940d25e8-011c-4af9-9ddb-8b9c1a44a06a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:10.591641 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-940d25e8-011c-4af9-9ddb-8b9c1a44a06a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:10.591641 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-940d25e8-011c-4af9-9ddb-8b9c1a44a06a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:10.591641 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-940d25e8-011c-4af9-9ddb-8b9c1a44a06a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:10.591941 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-940d25e8-011c-4af9-9ddb-8b9c1a44a06a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:10.744594 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-23a0e468-875a-45e2-b5b4-d94451db96c3 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:10.744594 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-23a0e468-875a-45e2-b5b4-d94451db96c3 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:10.749922 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-940d25e8-011c-4af9-9ddb-8b9c1a44a06a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:10.753015 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-23a0e468-875a-45e2-b5b4-d94451db96c3 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:10.754109 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-23a0e468-875a-45e2-b5b4-d94451db96c3 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:10.755557 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-23a0e468-875a-45e2-b5b4-d94451db96c3 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:10.756249 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-23a0e468-875a-45e2-b5b4-d94451db96c3 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:10.757706 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-940d25e8-011c-4af9-9ddb-8b9c1a44a06a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.184462 Dec 20 09:29:10.768078 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 91/158] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:10 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:10.931236 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-23a0e468-875a-45e2-b5b4-d94451db96c3 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:10.939384 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-23a0e468-875a-45e2-b5b4-d94451db96c3 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.204111 Dec 20 09:29:10.942997 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 68/159] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:10 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:11.152593 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-6329e056-14e7-4fd7-bf4f-12144dbbf49b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:11.154765 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-6329e056-14e7-4fd7-bf4f-12144dbbf49b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:11.172388 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6329e056-14e7-4fd7-bf4f-12144dbbf49b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:11.172987 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6329e056-14e7-4fd7-bf4f-12144dbbf49b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:11.180679 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6329e056-14e7-4fd7-bf4f-12144dbbf49b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:11.180679 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6329e056-14e7-4fd7-bf4f-12144dbbf49b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:11.291809 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-6329e056-14e7-4fd7-bf4f-12144dbbf49b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 14 microversion: 2.20 time: 0.143197 Dec 20 09:29:11.292511 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 92/160] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:11 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:11.774814 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-692beff6-e935-416c-b7e2-3794221a697d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:11.775424 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-692beff6-e935-416c-b7e2-3794221a697d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:11.781623 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-692beff6-e935-416c-b7e2-3794221a697d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:11.782075 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-692beff6-e935-416c-b7e2-3794221a697d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:11.782859 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-692beff6-e935-416c-b7e2-3794221a697d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:11.783286 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-692beff6-e935-416c-b7e2-3794221a697d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:11.943377 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-692beff6-e935-416c-b7e2-3794221a697d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:11.952782 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-692beff6-e935-416c-b7e2-3794221a697d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.182096 Dec 20 09:29:11.953358 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 69/161] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:11 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:11.961235 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-960554ed-8797-4021-9b01-0d6c65d71664 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:11.962472 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-960554ed-8797-4021-9b01-0d6c65d71664 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:11.969206 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-960554ed-8797-4021-9b01-0d6c65d71664 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:11.969648 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-960554ed-8797-4021-9b01-0d6c65d71664 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:11.970566 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-960554ed-8797-4021-9b01-0d6c65d71664 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:11.971006 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-960554ed-8797-4021-9b01-0d6c65d71664 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:12.108930 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-960554ed-8797-4021-9b01-0d6c65d71664 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:12.116382 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-960554ed-8797-4021-9b01-0d6c65d71664 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.162765 Dec 20 09:29:12.119775 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 93/162] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:11 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:12.302229 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c48462b4-d077-493c-848b-b17b8359e3a1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:12.303180 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c48462b4-d077-493c-848b-b17b8359e3a1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:12.309561 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c48462b4-d077-493c-848b-b17b8359e3a1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:12.310007 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c48462b4-d077-493c-848b-b17b8359e3a1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:12.310806 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c48462b4-d077-493c-848b-b17b8359e3a1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:12.311232 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c48462b4-d077-493c-848b-b17b8359e3a1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:12.814219 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c48462b4-d077-493c-848b-b17b8359e3a1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 14 microversion: 2.20 time: 0.515496 Dec 20 09:29:12.814900 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 70/163] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:12 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 14 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:12.969711 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-947467f9-3cad-4690-b079-8748f1dcb793 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:12.970316 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-947467f9-3cad-4690-b079-8748f1dcb793 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:12.976622 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-947467f9-3cad-4690-b079-8748f1dcb793 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:12.977637 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-947467f9-3cad-4690-b079-8748f1dcb793 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:12.978403 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-947467f9-3cad-4690-b079-8748f1dcb793 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:12.978878 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-947467f9-3cad-4690-b079-8748f1dcb793 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:13.111249 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-947467f9-3cad-4690-b079-8748f1dcb793 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:13.119042 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-947467f9-3cad-4690-b079-8748f1dcb793 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.152908 Dec 20 09:29:13.119606 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 94/164] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:12 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:13.134044 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-25fcfed0-8fef-4913-9514-a8189a178dbc tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:13.134745 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-25fcfed0-8fef-4913-9514-a8189a178dbc tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:13.141540 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-25fcfed0-8fef-4913-9514-a8189a178dbc tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:13.141986 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-25fcfed0-8fef-4913-9514-a8189a178dbc tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:13.142757 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-25fcfed0-8fef-4913-9514-a8189a178dbc tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:13.143192 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-25fcfed0-8fef-4913-9514-a8189a178dbc tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:13.278013 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-25fcfed0-8fef-4913-9514-a8189a178dbc tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:13.285282 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-25fcfed0-8fef-4913-9514-a8189a178dbc tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.155288 Dec 20 09:29:13.285848 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 71/165] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:13 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:13.826269 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3dc32242-77a6-4409-8649-cd69fe27b6f4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:13.827186 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-3dc32242-77a6-4409-8649-cd69fe27b6f4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:13.833607 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3dc32242-77a6-4409-8649-cd69fe27b6f4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:13.834057 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3dc32242-77a6-4409-8649-cd69fe27b6f4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:13.834869 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3dc32242-77a6-4409-8649-cd69fe27b6f4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:13.835308 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3dc32242-77a6-4409-8649-cd69fe27b6f4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:14.135934 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a5e48f74-62bd-4264-a220-572bed7edf73 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:14.136572 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a5e48f74-62bd-4264-a220-572bed7edf73 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:14.142831 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a5e48f74-62bd-4264-a220-572bed7edf73 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:14.143274 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a5e48f74-62bd-4264-a220-572bed7edf73 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:14.144082 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a5e48f74-62bd-4264-a220-572bed7edf73 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:14.144513 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a5e48f74-62bd-4264-a220-572bed7edf73 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:14.273415 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a5e48f74-62bd-4264-a220-572bed7edf73 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:14.281215 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a5e48f74-62bd-4264-a220-572bed7edf73 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.149418 Dec 20 09:29:14.281792 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 72/166] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:14 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:14.301760 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d619c9b3-cf49-4531-af53-b52b4af2abc0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:14.302359 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d619c9b3-cf49-4531-af53-b52b4af2abc0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:14.308207 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d619c9b3-cf49-4531-af53-b52b4af2abc0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:14.308650 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d619c9b3-cf49-4531-af53-b52b4af2abc0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:14.309416 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d619c9b3-cf49-4531-af53-b52b4af2abc0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:14.309847 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d619c9b3-cf49-4531-af53-b52b4af2abc0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:14.450350 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d619c9b3-cf49-4531-af53-b52b4af2abc0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:14.457500 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d619c9b3-cf49-4531-af53-b52b4af2abc0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.159218 Dec 20 09:29:14.458068 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 73/167] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:14 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:15.297589 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ab2fbbb1-805b-4f81-a60a-d7ddfe96f36d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:15.298213 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ab2fbbb1-805b-4f81-a60a-d7ddfe96f36d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:15.304319 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ab2fbbb1-805b-4f81-a60a-d7ddfe96f36d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:15.304768 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ab2fbbb1-805b-4f81-a60a-d7ddfe96f36d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:15.305535 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ab2fbbb1-805b-4f81-a60a-d7ddfe96f36d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:15.305967 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ab2fbbb1-805b-4f81-a60a-d7ddfe96f36d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:15.434353 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ab2fbbb1-805b-4f81-a60a-d7ddfe96f36d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:15.441774 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ab2fbbb1-805b-4f81-a60a-d7ddfe96f36d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.147867 Dec 20 09:29:15.442346 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 74/168] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:15 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:15.473261 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-08c00fd6-5c35-407e-89ea-643fdfd734e6 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:15.473863 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-08c00fd6-5c35-407e-89ea-643fdfd734e6 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:15.480009 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-08c00fd6-5c35-407e-89ea-643fdfd734e6 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:15.480456 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-08c00fd6-5c35-407e-89ea-643fdfd734e6 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:15.481226 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-08c00fd6-5c35-407e-89ea-643fdfd734e6 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:15.481662 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-08c00fd6-5c35-407e-89ea-643fdfd734e6 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:15.605302 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-08c00fd6-5c35-407e-89ea-643fdfd734e6 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:15.612739 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-08c00fd6-5c35-407e-89ea-643fdfd734e6 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.142748 Dec 20 09:29:15.619524 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 75/169] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:15 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:16.458083 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6ca2fa67-a54e-472f-8b5e-0352e26716d4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:16.458691 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6ca2fa67-a54e-472f-8b5e-0352e26716d4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:16.465598 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6ca2fa67-a54e-472f-8b5e-0352e26716d4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:16.466047 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6ca2fa67-a54e-472f-8b5e-0352e26716d4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:16.466819 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6ca2fa67-a54e-472f-8b5e-0352e26716d4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:16.467256 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6ca2fa67-a54e-472f-8b5e-0352e26716d4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:16.592188 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6ca2fa67-a54e-472f-8b5e-0352e26716d4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:16.599331 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6ca2fa67-a54e-472f-8b5e-0352e26716d4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.144834 Dec 20 09:29:16.600000 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 76/170] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:16 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:16.634446 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-cac6f21d-7688-4439-a887-6ce8422b9088 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:16.635092 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-cac6f21d-7688-4439-a887-6ce8422b9088 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:16.640857 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cac6f21d-7688-4439-a887-6ce8422b9088 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:16.641305 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cac6f21d-7688-4439-a887-6ce8422b9088 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:16.642080 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cac6f21d-7688-4439-a887-6ce8422b9088 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:16.642516 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cac6f21d-7688-4439-a887-6ce8422b9088 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:16.773300 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-cac6f21d-7688-4439-a887-6ce8422b9088 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:16.780462 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-cac6f21d-7688-4439-a887-6ce8422b9088 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.149959 Dec 20 09:29:16.781029 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 77/171] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:16 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:17.615716 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ca361b2f-ccc1-45b9-bd19-488b70df05fc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:17.616349 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ca361b2f-ccc1-45b9-bd19-488b70df05fc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:17.622595 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ca361b2f-ccc1-45b9-bd19-488b70df05fc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:17.623045 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ca361b2f-ccc1-45b9-bd19-488b70df05fc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:17.623864 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ca361b2f-ccc1-45b9-bd19-488b70df05fc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:17.624300 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ca361b2f-ccc1-45b9-bd19-488b70df05fc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:17.749028 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ca361b2f-ccc1-45b9-bd19-488b70df05fc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:17.756512 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ca361b2f-ccc1-45b9-bd19-488b70df05fc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.144601 Dec 20 09:29:17.757079 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 78/172] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:17 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:17.796499 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d08e0ded-cfaa-4736-9088-2a9921d755e3 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:17.797109 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d08e0ded-cfaa-4736-9088-2a9921d755e3 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:17.803227 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d08e0ded-cfaa-4736-9088-2a9921d755e3 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:17.803703 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d08e0ded-cfaa-4736-9088-2a9921d755e3 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:17.804496 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d08e0ded-cfaa-4736-9088-2a9921d755e3 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:17.804931 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d08e0ded-cfaa-4736-9088-2a9921d755e3 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:17.939210 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d08e0ded-cfaa-4736-9088-2a9921d755e3 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:17.947113 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d08e0ded-cfaa-4736-9088-2a9921d755e3 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.154117 Dec 20 09:29:17.947687 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 79/173] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:17 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:18.771894 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0799fb33-faca-4d93-9e6c-d28e69bf6134 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:18.772520 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0799fb33-faca-4d93-9e6c-d28e69bf6134 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:18.778730 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0799fb33-faca-4d93-9e6c-d28e69bf6134 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:18.779292 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0799fb33-faca-4d93-9e6c-d28e69bf6134 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:18.779960 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0799fb33-faca-4d93-9e6c-d28e69bf6134 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:18.780394 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0799fb33-faca-4d93-9e6c-d28e69bf6134 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:18.860927 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3dc32242-77a6-4409-8649-cd69fe27b6f4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 14 microversion: 2.20 time: 5.038832 Dec 20 09:29:18.863712 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 95/174] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:13 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 14 bytes in 5041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:18.927709 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-0799fb33-faca-4d93-9e6c-d28e69bf6134 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:18.938104 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0799fb33-faca-4d93-9e6c-d28e69bf6134 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.169872 Dec 20 09:29:18.938710 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 80/175] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:18 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:18.966326 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5e058ca4-1b52-4350-8551-7ca2b780c406 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:18.967137 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-5e058ca4-1b52-4350-8551-7ca2b780c406 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:18.975691 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5e058ca4-1b52-4350-8551-7ca2b780c406 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:18.975862 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5e058ca4-1b52-4350-8551-7ca2b780c406 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:18.979619 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5e058ca4-1b52-4350-8551-7ca2b780c406 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:18.979619 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5e058ca4-1b52-4350-8551-7ca2b780c406 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:19.118790 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-5e058ca4-1b52-4350-8551-7ca2b780c406 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:19.126006 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-5e058ca4-1b52-4350-8551-7ca2b780c406 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.165295 Dec 20 09:29:19.126571 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 96/176] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:18 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:19.871960 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c7b82b9c-f2a7-4da1-9378-8fd3b9251db2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:19.872862 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c7b82b9c-f2a7-4da1-9378-8fd3b9251db2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:19.879192 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c7b82b9c-f2a7-4da1-9378-8fd3b9251db2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:19.879627 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c7b82b9c-f2a7-4da1-9378-8fd3b9251db2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:19.880424 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c7b82b9c-f2a7-4da1-9378-8fd3b9251db2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:19.880848 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c7b82b9c-f2a7-4da1-9378-8fd3b9251db2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:19.966126 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9d5c7654-4a70-4962-86ed-5f1cff3ff4b3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:19.966734 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9d5c7654-4a70-4962-86ed-5f1cff3ff4b3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:19.973096 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9d5c7654-4a70-4962-86ed-5f1cff3ff4b3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:19.973531 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9d5c7654-4a70-4962-86ed-5f1cff3ff4b3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:19.974314 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9d5c7654-4a70-4962-86ed-5f1cff3ff4b3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:19.974742 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9d5c7654-4a70-4962-86ed-5f1cff3ff4b3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:20.106783 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-9d5c7654-4a70-4962-86ed-5f1cff3ff4b3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:20.114252 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9d5c7654-4a70-4962-86ed-5f1cff3ff4b3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.152643 Dec 20 09:29:20.114750 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 97/177] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:19 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:20.142414 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7d2c1019-16da-4456-a6e9-9250962042ee tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:20.143058 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7d2c1019-16da-4456-a6e9-9250962042ee tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:20.149255 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7d2c1019-16da-4456-a6e9-9250962042ee tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:20.149706 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7d2c1019-16da-4456-a6e9-9250962042ee tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:20.150489 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7d2c1019-16da-4456-a6e9-9250962042ee tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:20.150920 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7d2c1019-16da-4456-a6e9-9250962042ee tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:20.279722 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7d2c1019-16da-4456-a6e9-9250962042ee tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:20.287476 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7d2c1019-16da-4456-a6e9-9250962042ee tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.148884 Dec 20 09:29:20.291284 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 98/178] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:20 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:21.131419 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1d4b0403-f4a8-43e0-a893-9064153d203f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:21.132186 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-1d4b0403-f4a8-43e0-a893-9064153d203f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:21.140165 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1d4b0403-f4a8-43e0-a893-9064153d203f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:21.140619 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1d4b0403-f4a8-43e0-a893-9064153d203f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:21.141416 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1d4b0403-f4a8-43e0-a893-9064153d203f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:21.141850 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1d4b0403-f4a8-43e0-a893-9064153d203f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:21.276640 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1d4b0403-f4a8-43e0-a893-9064153d203f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:21.283834 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1d4b0403-f4a8-43e0-a893-9064153d203f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.156394 Dec 20 09:29:21.284407 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 99/179] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:21 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:21.304229 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ef8c208d-58f7-44ee-8c30-045bee464205 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:21.304862 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ef8c208d-58f7-44ee-8c30-045bee464205 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:21.311293 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ef8c208d-58f7-44ee-8c30-045bee464205 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:21.311774 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ef8c208d-58f7-44ee-8c30-045bee464205 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:21.312566 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ef8c208d-58f7-44ee-8c30-045bee464205 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:21.313003 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ef8c208d-58f7-44ee-8c30-045bee464205 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:21.439178 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ef8c208d-58f7-44ee-8c30-045bee464205 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:21.447065 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ef8c208d-58f7-44ee-8c30-045bee464205 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.146217 Dec 20 09:29:21.447633 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 100/180] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:21 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:22.299966 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-936340b9-f48f-4cbf-ad11-d2af6ba84637 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:22.300576 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-936340b9-f48f-4cbf-ad11-d2af6ba84637 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:22.307489 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-936340b9-f48f-4cbf-ad11-d2af6ba84637 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:22.307957 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-936340b9-f48f-4cbf-ad11-d2af6ba84637 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:22.308790 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-936340b9-f48f-4cbf-ad11-d2af6ba84637 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:22.309231 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-936340b9-f48f-4cbf-ad11-d2af6ba84637 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:22.440054 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-936340b9-f48f-4cbf-ad11-d2af6ba84637 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:22.447332 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-936340b9-f48f-4cbf-ad11-d2af6ba84637 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.150911 Dec 20 09:29:22.447929 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 101/181] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:22 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:22.462687 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0ab184b0-a9c9-4f53-b54d-4862bc327e63 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:22.463284 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0ab184b0-a9c9-4f53-b54d-4862bc327e63 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:22.468659 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0ab184b0-a9c9-4f53-b54d-4862bc327e63 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:22.469100 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0ab184b0-a9c9-4f53-b54d-4862bc327e63 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:22.469869 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0ab184b0-a9c9-4f53-b54d-4862bc327e63 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:22.470297 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0ab184b0-a9c9-4f53-b54d-4862bc327e63 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:22.594246 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-0ab184b0-a9c9-4f53-b54d-4862bc327e63 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:22.601407 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0ab184b0-a9c9-4f53-b54d-4862bc327e63 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.141923 Dec 20 09:29:22.602484 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 102/182] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:22 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:23.155217 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c7b82b9c-f2a7-4da1-9378-8fd3b9251db2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 14 microversion: 2.20 time: 3.287301 Dec 20 09:29:23.155991 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 81/183] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:19 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 14 bytes in 3289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:23.463460 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a361aaeb-f74d-4cbd-8808-c28e6172c422 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:23.464108 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a361aaeb-f74d-4cbd-8808-c28e6172c422 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:23.470361 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a361aaeb-f74d-4cbd-8808-c28e6172c422 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:23.470810 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a361aaeb-f74d-4cbd-8808-c28e6172c422 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:23.471593 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a361aaeb-f74d-4cbd-8808-c28e6172c422 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:23.472106 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a361aaeb-f74d-4cbd-8808-c28e6172c422 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:23.596851 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a361aaeb-f74d-4cbd-8808-c28e6172c422 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:23.604113 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a361aaeb-f74d-4cbd-8808-c28e6172c422 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.144181 Dec 20 09:29:23.604684 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 103/184] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:23 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:23.618908 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f7e90291-d791-4599-9720-9cdbb034f85b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:23.619700 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f7e90291-d791-4599-9720-9cdbb034f85b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:23.626436 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f7e90291-d791-4599-9720-9cdbb034f85b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:23.626883 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f7e90291-d791-4599-9720-9cdbb034f85b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:23.627673 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f7e90291-d791-4599-9720-9cdbb034f85b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:23.628113 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f7e90291-d791-4599-9720-9cdbb034f85b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:23.759047 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f7e90291-d791-4599-9720-9cdbb034f85b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:23.766993 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f7e90291-d791-4599-9720-9cdbb034f85b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.152579 Dec 20 09:29:23.767556 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 82/185] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:23 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:24.166099 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-37d38dab-40b0-48f8-a658-a3b996789318 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:24.167045 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-37d38dab-40b0-48f8-a658-a3b996789318 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:24.172848 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37d38dab-40b0-48f8-a658-a3b996789318 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:24.173296 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37d38dab-40b0-48f8-a658-a3b996789318 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:24.174071 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37d38dab-40b0-48f8-a658-a3b996789318 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:24.174503 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37d38dab-40b0-48f8-a658-a3b996789318 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:24.620787 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-65d8db1f-99c1-425e-9539-b5cc3c4c842e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:24.621322 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-65d8db1f-99c1-425e-9539-b5cc3c4c842e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:24.627565 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-65d8db1f-99c1-425e-9539-b5cc3c4c842e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:24.628042 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-65d8db1f-99c1-425e-9539-b5cc3c4c842e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:24.629075 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-65d8db1f-99c1-425e-9539-b5cc3c4c842e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:24.629509 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-65d8db1f-99c1-425e-9539-b5cc3c4c842e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:24.757195 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-65d8db1f-99c1-425e-9539-b5cc3c4c842e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:24.764398 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-65d8db1f-99c1-425e-9539-b5cc3c4c842e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.147363 Dec 20 09:29:24.764980 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 83/186] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:24 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:24.782727 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-5584fa0a-5fec-47df-be02-1993b2c1bb7b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:24.783329 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-5584fa0a-5fec-47df-be02-1993b2c1bb7b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:24.788843 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5584fa0a-5fec-47df-be02-1993b2c1bb7b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:24.789288 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5584fa0a-5fec-47df-be02-1993b2c1bb7b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:24.790574 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5584fa0a-5fec-47df-be02-1993b2c1bb7b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:24.791010 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5584fa0a-5fec-47df-be02-1993b2c1bb7b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:24.931673 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-5584fa0a-5fec-47df-be02-1993b2c1bb7b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:24.939003 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-5584fa0a-5fec-47df-be02-1993b2c1bb7b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.159513 Dec 20 09:29:24.939853 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 84/187] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:24 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:25.133891 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-37d38dab-40b0-48f8-a658-a3b996789318 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 14 microversion: 2.20 time: 0.971682 Dec 20 09:29:25.134675 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 104/188] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:24 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 14 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:25.780744 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2b7bff39-37a9-4a6d-8003-10cc51169cde tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:25.781275 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2b7bff39-37a9-4a6d-8003-10cc51169cde tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:25.787475 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2b7bff39-37a9-4a6d-8003-10cc51169cde tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:25.787961 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2b7bff39-37a9-4a6d-8003-10cc51169cde tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:25.788734 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2b7bff39-37a9-4a6d-8003-10cc51169cde tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:25.789173 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2b7bff39-37a9-4a6d-8003-10cc51169cde tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:25.915976 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-2b7bff39-37a9-4a6d-8003-10cc51169cde tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:25.923401 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2b7bff39-37a9-4a6d-8003-10cc51169cde tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.146222 Dec 20 09:29:25.927909 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 85/189] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:25 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:25.955842 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ba4d38e7-2c61-4fea-a905-461474458770 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:25.956547 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ba4d38e7-2c61-4fea-a905-461474458770 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:25.963498 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ba4d38e7-2c61-4fea-a905-461474458770 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:25.963978 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ba4d38e7-2c61-4fea-a905-461474458770 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:25.964758 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ba4d38e7-2c61-4fea-a905-461474458770 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:25.965194 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ba4d38e7-2c61-4fea-a905-461474458770 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:26.094470 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ba4d38e7-2c61-4fea-a905-461474458770 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:26.102604 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ba4d38e7-2c61-4fea-a905-461474458770 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.150297 Dec 20 09:29:26.103175 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 105/190] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:25 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:26.144756 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d1c24918-1d93-4532-bbc6-8c199ca28203 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:26.145657 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d1c24918-1d93-4532-bbc6-8c199ca28203 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:26.152287 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1c24918-1d93-4532-bbc6-8c199ca28203 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:26.152724 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1c24918-1d93-4532-bbc6-8c199ca28203 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:26.153489 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1c24918-1d93-4532-bbc6-8c199ca28203 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:26.153976 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1c24918-1d93-4532-bbc6-8c199ca28203 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:26.393447 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d1c24918-1d93-4532-bbc6-8c199ca28203 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 14 microversion: 2.20 time: 0.252343 Dec 20 09:29:26.394104 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 86/191] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:26 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 14 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:26.940313 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7d04bc8e-0e93-49be-a65f-c302cb215175 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:26.940929 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7d04bc8e-0e93-49be-a65f-c302cb215175 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:26.947759 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7d04bc8e-0e93-49be-a65f-c302cb215175 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:26.948210 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7d04bc8e-0e93-49be-a65f-c302cb215175 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:26.948980 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7d04bc8e-0e93-49be-a65f-c302cb215175 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:26.949411 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7d04bc8e-0e93-49be-a65f-c302cb215175 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:27.082972 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7d04bc8e-0e93-49be-a65f-c302cb215175 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:27.090864 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7d04bc8e-0e93-49be-a65f-c302cb215175 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.154211 Dec 20 09:29:27.091465 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 106/192] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:26 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:27.118585 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-3880c951-f501-4434-bcbc-6cd221895ea8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:27.119294 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-3880c951-f501-4434-bcbc-6cd221895ea8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:27.126162 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3880c951-f501-4434-bcbc-6cd221895ea8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:27.126611 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3880c951-f501-4434-bcbc-6cd221895ea8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:27.127382 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3880c951-f501-4434-bcbc-6cd221895ea8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:27.127886 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3880c951-f501-4434-bcbc-6cd221895ea8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:27.260995 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-3880c951-f501-4434-bcbc-6cd221895ea8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:27.268308 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-3880c951-f501-4434-bcbc-6cd221895ea8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.153753 Dec 20 09:29:27.268869 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 87/193] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:27 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:27.404324 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-918f655c-7f8b-4245-9bc7-3686e1b99536 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:27.405243 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-918f655c-7f8b-4245-9bc7-3686e1b99536 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:27.411895 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-918f655c-7f8b-4245-9bc7-3686e1b99536 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:27.412096 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-918f655c-7f8b-4245-9bc7-3686e1b99536 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:27.412793 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-918f655c-7f8b-4245-9bc7-3686e1b99536 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:27.413298 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-918f655c-7f8b-4245-9bc7-3686e1b99536 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:28.108919 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-32f4e3f1-faa4-4a99-b04a-ddc7a93efb50 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:28.109944 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-32f4e3f1-faa4-4a99-b04a-ddc7a93efb50 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:28.117606 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-32f4e3f1-faa4-4a99-b04a-ddc7a93efb50 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:28.118820 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-32f4e3f1-faa4-4a99-b04a-ddc7a93efb50 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:28.120431 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-32f4e3f1-faa4-4a99-b04a-ddc7a93efb50 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:28.121248 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-32f4e3f1-faa4-4a99-b04a-ddc7a93efb50 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:28.254409 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-32f4e3f1-faa4-4a99-b04a-ddc7a93efb50 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:28.262779 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-32f4e3f1-faa4-4a99-b04a-ddc7a93efb50 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.159098 Dec 20 09:29:28.263750 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 88/194] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:28 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:28.284150 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6bcc6262-9e86-4453-a1eb-9eb3dd33a0a8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:28.284792 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6bcc6262-9e86-4453-a1eb-9eb3dd33a0a8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:28.291186 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6bcc6262-9e86-4453-a1eb-9eb3dd33a0a8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:28.291632 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6bcc6262-9e86-4453-a1eb-9eb3dd33a0a8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:28.306711 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6bcc6262-9e86-4453-a1eb-9eb3dd33a0a8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:28.306711 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6bcc6262-9e86-4453-a1eb-9eb3dd33a0a8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:28.422319 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6bcc6262-9e86-4453-a1eb-9eb3dd33a0a8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:28.429991 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6bcc6262-9e86-4453-a1eb-9eb3dd33a0a8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.149503 Dec 20 09:29:28.431142 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 89/195] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:28 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:29.282095 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-47f8d5ee-da1a-466f-bebd-3a3fdaac2f8e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:29.282746 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-47f8d5ee-da1a-466f-bebd-3a3fdaac2f8e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:29.289479 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-47f8d5ee-da1a-466f-bebd-3a3fdaac2f8e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:29.289998 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-47f8d5ee-da1a-466f-bebd-3a3fdaac2f8e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:29.291410 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-47f8d5ee-da1a-466f-bebd-3a3fdaac2f8e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:29.291888 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-47f8d5ee-da1a-466f-bebd-3a3fdaac2f8e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:29.419332 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-47f8d5ee-da1a-466f-bebd-3a3fdaac2f8e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:29.426542 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-47f8d5ee-da1a-466f-bebd-3a3fdaac2f8e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.150421 Dec 20 09:29:29.427108 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 90/196] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:29 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:29.447855 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-3e992a89-521e-4b76-87d8-51bf4c561fd5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:29.448458 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-3e992a89-521e-4b76-87d8-51bf4c561fd5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:29.454144 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3e992a89-521e-4b76-87d8-51bf4c561fd5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:29.454604 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3e992a89-521e-4b76-87d8-51bf4c561fd5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:29.455374 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3e992a89-521e-4b76-87d8-51bf4c561fd5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:29.455841 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3e992a89-521e-4b76-87d8-51bf4c561fd5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:29.587018 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-3e992a89-521e-4b76-87d8-51bf4c561fd5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:29.594149 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-3e992a89-521e-4b76-87d8-51bf4c561fd5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.150372 Dec 20 09:29:29.594719 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 91/197] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:29 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:30.443350 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f1436500-54ed-4f9d-95e3-53ef8c24dda1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:30.444008 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f1436500-54ed-4f9d-95e3-53ef8c24dda1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:30.450256 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f1436500-54ed-4f9d-95e3-53ef8c24dda1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:30.450703 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f1436500-54ed-4f9d-95e3-53ef8c24dda1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:30.451476 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f1436500-54ed-4f9d-95e3-53ef8c24dda1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:30.451939 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f1436500-54ed-4f9d-95e3-53ef8c24dda1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:30.579145 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f1436500-54ed-4f9d-95e3-53ef8c24dda1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:30.586402 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f1436500-54ed-4f9d-95e3-53ef8c24dda1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.146749 Dec 20 09:29:30.587628 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 92/198] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:30 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:30.607046 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-918f655c-7f8b-4245-9bc7-3686e1b99536 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 11132 microversion: 2.20 time: 3.206197 Dec 20 09:29:30.617116 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 107/199] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:27 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 11132 bytes in 3209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:29:30.617284 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-cab7818f-2144-43b4-9b27-db2a0e210881 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:30.617284 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-cab7818f-2144-43b4-9b27-db2a0e210881 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:30.617284 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cab7818f-2144-43b4-9b27-db2a0e210881 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:30.617284 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cab7818f-2144-43b4-9b27-db2a0e210881 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:30.617618 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cab7818f-2144-43b4-9b27-db2a0e210881 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:30.618139 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cab7818f-2144-43b4-9b27-db2a0e210881 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:30.752081 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-cab7818f-2144-43b4-9b27-db2a0e210881 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:30.757225 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-cab7818f-2144-43b4-9b27-db2a0e210881 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.150909 Dec 20 09:29:30.758271 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 93/200] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:30 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:31.604575 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-57ea1cd3-cc4e-4426-92aa-cb4eaf291ba0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:31.605210 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-57ea1cd3-cc4e-4426-92aa-cb4eaf291ba0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:31.612280 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-57ea1cd3-cc4e-4426-92aa-cb4eaf291ba0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:31.618574 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-57ea1cd3-cc4e-4426-92aa-cb4eaf291ba0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:31.618574 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-57ea1cd3-cc4e-4426-92aa-cb4eaf291ba0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:31.618574 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-57ea1cd3-cc4e-4426-92aa-cb4eaf291ba0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:31.626357 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b26c6ed8-631c-47ed-93f4-97d75275be4d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:31.627277 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b26c6ed8-631c-47ed-93f4-97d75275be4d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:31.634451 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b26c6ed8-631c-47ed-93f4-97d75275be4d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:31.634909 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b26c6ed8-631c-47ed-93f4-97d75275be4d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:31.636201 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b26c6ed8-631c-47ed-93f4-97d75275be4d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:31.636727 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b26c6ed8-631c-47ed-93f4-97d75275be4d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:31.746788 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-57ea1cd3-cc4e-4426-92aa-cb4eaf291ba0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:31.754788 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-57ea1cd3-cc4e-4426-92aa-cb4eaf291ba0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.154928 Dec 20 09:29:31.755358 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 108/201] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:31 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:31.773475 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-6dddcf45-2450-4bd0-b724-7418cfd1c36a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:31.774585 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-6dddcf45-2450-4bd0-b724-7418cfd1c36a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:31.780342 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6dddcf45-2450-4bd0-b724-7418cfd1c36a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:31.780796 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6dddcf45-2450-4bd0-b724-7418cfd1c36a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:31.781915 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6dddcf45-2450-4bd0-b724-7418cfd1c36a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:31.781989 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6dddcf45-2450-4bd0-b724-7418cfd1c36a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:31.912122 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-6dddcf45-2450-4bd0-b724-7418cfd1c36a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:31.919223 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-6dddcf45-2450-4bd0-b724-7418cfd1c36a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.149081 Dec 20 09:29:31.919833 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 109/202] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:31 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:32.445407 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b26c6ed8-631c-47ed-93f4-97d75275be4d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 18128 microversion: 2.20 time: 0.822716 Dec 20 09:29:32.446714 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 94/203] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:31 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 18128 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:29:32.769974 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a17a3886-9add-49c3-ba42-822813792a8a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:32.770636 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a17a3886-9add-49c3-ba42-822813792a8a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:32.770745 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-fc21b6ca-f148-4fe8-8034-b1159305a409 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:32.771262 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-fc21b6ca-f148-4fe8-8034-b1159305a409 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:32.777090 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a17a3886-9add-49c3-ba42-822813792a8a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:32.777531 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a17a3886-9add-49c3-ba42-822813792a8a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:32.777995 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fc21b6ca-f148-4fe8-8034-b1159305a409 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:32.778357 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a17a3886-9add-49c3-ba42-822813792a8a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:32.778467 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fc21b6ca-f148-4fe8-8034-b1159305a409 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:32.778900 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a17a3886-9add-49c3-ba42-822813792a8a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:32.779213 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fc21b6ca-f148-4fe8-8034-b1159305a409 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:32.779643 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fc21b6ca-f148-4fe8-8034-b1159305a409 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:32.804791 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-fc21b6ca-f148-4fe8-8034-b1159305a409 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Going to try to terminate instance {{(pid=116675) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 09:29:32.930008 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a17a3886-9add-49c3-ba42-822813792a8a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:32.937541 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a17a3886-9add-49c3-ba42-822813792a8a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.171266 Dec 20 09:29:32.938111 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 110/204] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:32 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:32.942384 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9867b0a0-6eb0-4090-9154-c28db838520e tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:32.943001 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9867b0a0-6eb0-4090-9154-c28db838520e tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:32.948943 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9867b0a0-6eb0-4090-9154-c28db838520e tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:32.949396 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9867b0a0-6eb0-4090-9154-c28db838520e tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:32.950181 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9867b0a0-6eb0-4090-9154-c28db838520e tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:32.950651 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9867b0a0-6eb0-4090-9154-c28db838520e tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:33.091098 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-9867b0a0-6eb0-4090-9154-c28db838520e tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:33.092874 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-fc21b6ca-f148-4fe8-8034-b1159305a409 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "DELETE /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 204 len: 0 microversion: 2.1 time: 0.325869 Dec 20 09:29:33.093930 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 95/205] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 20 09:29:32 2021] DELETE /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 20 09:29:33.099383 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9867b0a0-6eb0-4090-9154-c28db838520e tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.160195 Dec 20 09:29:33.101598 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 111/206] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:32 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:33.102357 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d32728b5-1094-4fe9-af86-dc541a43d42e tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:33.104019 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d32728b5-1094-4fe9-af86-dc541a43d42e tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:33.111156 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d32728b5-1094-4fe9-af86-dc541a43d42e tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:33.111617 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d32728b5-1094-4fe9-af86-dc541a43d42e tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:33.112433 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d32728b5-1094-4fe9-af86-dc541a43d42e tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:33.112916 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d32728b5-1094-4fe9-af86-dc541a43d42e tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:33.242466 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d32728b5-1094-4fe9-af86-dc541a43d42e tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:33.250878 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d32728b5-1094-4fe9-af86-dc541a43d42e tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1553 microversion: 2.1 time: 0.152404 Dec 20 09:29:33.251466 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 96/207] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:33 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:33.457409 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-df89baf3-5778-4395-9589-7902ee2ecc34 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:33.458321 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-df89baf3-5778-4395-9589-7902ee2ecc34 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:33.465134 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-df89baf3-5778-4395-9589-7902ee2ecc34 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:33.465577 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-df89baf3-5778-4395-9589-7902ee2ecc34 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:33.466347 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-df89baf3-5778-4395-9589-7902ee2ecc34 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:33.466778 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-df89baf3-5778-4395-9589-7902ee2ecc34 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:33.625652 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-df89baf3-5778-4395-9589-7902ee2ecc34 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 19175 microversion: 2.20 time: 0.171701 Dec 20 09:29:33.626226 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 112/208] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:33 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 19175 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:29:33.954953 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-436770da-ea25-40b5-9782-22820e2e72d1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:33.955569 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-436770da-ea25-40b5-9782-22820e2e72d1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:33.962524 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-436770da-ea25-40b5-9782-22820e2e72d1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:33.962980 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-436770da-ea25-40b5-9782-22820e2e72d1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:33.963797 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-436770da-ea25-40b5-9782-22820e2e72d1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:33.964236 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-436770da-ea25-40b5-9782-22820e2e72d1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:34.096666 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-436770da-ea25-40b5-9782-22820e2e72d1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:34.103901 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-436770da-ea25-40b5-9782-22820e2e72d1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.152874 Dec 20 09:29:34.106924 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 97/209] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:33 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:34.117188 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5a439120-39cf-4d96-a901-7d949d250c28 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:34.118448 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-5a439120-39cf-4d96-a901-7d949d250c28 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:34.125274 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5a439120-39cf-4d96-a901-7d949d250c28 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:34.125725 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5a439120-39cf-4d96-a901-7d949d250c28 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:34.126502 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5a439120-39cf-4d96-a901-7d949d250c28 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:34.126943 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5a439120-39cf-4d96-a901-7d949d250c28 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:34.267511 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-5a439120-39cf-4d96-a901-7d949d250c28 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:34.271593 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-de279ff8-8295-4ea2-910a-5599408d31bb tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:34.272426 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-de279ff8-8295-4ea2-910a-5599408d31bb tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:34.275444 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-5a439120-39cf-4d96-a901-7d949d250c28 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.162268 Dec 20 09:29:34.276270 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 113/210] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:34 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:34.278702 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-de279ff8-8295-4ea2-910a-5599408d31bb tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:34.279160 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-de279ff8-8295-4ea2-910a-5599408d31bb tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:34.280007 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-de279ff8-8295-4ea2-910a-5599408d31bb tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:34.280443 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-de279ff8-8295-4ea2-910a-5599408d31bb tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:34.416826 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-de279ff8-8295-4ea2-910a-5599408d31bb tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:34.425022 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-de279ff8-8295-4ea2-910a-5599408d31bb tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1553 microversion: 2.1 time: 0.157915 Dec 20 09:29:34.425653 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 98/211] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:34 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:34.637341 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f3df81b9-342f-4867-983b-727847f305b6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:34.638382 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f3df81b9-342f-4867-983b-727847f305b6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:34.645212 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f3df81b9-342f-4867-983b-727847f305b6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:34.645669 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f3df81b9-342f-4867-983b-727847f305b6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:34.646461 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f3df81b9-342f-4867-983b-727847f305b6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:34.646898 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f3df81b9-342f-4867-983b-727847f305b6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:34.755453 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f3df81b9-342f-4867-983b-727847f305b6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 20164 microversion: 2.20 time: 0.121650 Dec 20 09:29:34.759225 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 114/212] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:34 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 20164 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:29:34.891319 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-5c0bc1ea-0c34-4818-a339-a214d49deaa5 req-a569b55a-7beb-481f-a84d-60082a8bcce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d4cec5f-091a-4dbf-8e38-aafb2b24f957", "name": "network-vif-plugged", "status": "completed", "tag": "28297062-13cd-4a98-b825-64eed343639e"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:34.892940 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:29:34.892940 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:29:34.900672 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-5c0bc1ea-0c34-4818-a339-a214d49deaa5 req-a569b55a-7beb-481f-a84d-60082a8bcce5 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:34.901106 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-5c0bc1ea-0c34-4818-a339-a214d49deaa5 req-a569b55a-7beb-481f-a84d-60082a8bcce5 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:34.913429 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-5c0bc1ea-0c34-4818-a339-a214d49deaa5 req-a569b55a-7beb-481f-a84d-60082a8bcce5 service nova] Creating event network-vif-plugged:28297062-13cd-4a98-b825-64eed343639e for instance 5d4cec5f-091a-4dbf-8e38-aafb2b24f957 on hv-cinder-81908 Dec 20 09:29:34.918603 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-5c0bc1ea-0c34-4818-a339-a214d49deaa5 req-a569b55a-7beb-481f-a84d-60082a8bcce5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030880 Dec 20 09:29:34.919198 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 99/213] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:29:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:29:35.120956 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d7fe17cc-63a7-49cf-8f08-fefff198a1d1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:35.121649 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d7fe17cc-63a7-49cf-8f08-fefff198a1d1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:35.128925 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d7fe17cc-63a7-49cf-8f08-fefff198a1d1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:35.134166 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d7fe17cc-63a7-49cf-8f08-fefff198a1d1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:35.134166 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d7fe17cc-63a7-49cf-8f08-fefff198a1d1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:35.134166 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d7fe17cc-63a7-49cf-8f08-fefff198a1d1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:35.265690 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d7fe17cc-63a7-49cf-8f08-fefff198a1d1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:35.273195 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d7fe17cc-63a7-49cf-8f08-fefff198a1d1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.156229 Dec 20 09:29:35.273771 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 115/214] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:35 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:35.292657 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-56979d5d-dc4a-4108-8c54-253af63b61bf tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:35.293363 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-56979d5d-dc4a-4108-8c54-253af63b61bf tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:35.299216 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-56979d5d-dc4a-4108-8c54-253af63b61bf tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:35.299681 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-56979d5d-dc4a-4108-8c54-253af63b61bf tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:35.300461 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-56979d5d-dc4a-4108-8c54-253af63b61bf tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:35.300898 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-56979d5d-dc4a-4108-8c54-253af63b61bf tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:35.442115 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-927a5fa6-ee73-4a50-9dd8-e7c415620328 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:35.442891 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-927a5fa6-ee73-4a50-9dd8-e7c415620328 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:35.450523 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-927a5fa6-ee73-4a50-9dd8-e7c415620328 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:35.451144 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-927a5fa6-ee73-4a50-9dd8-e7c415620328 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:35.452144 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-927a5fa6-ee73-4a50-9dd8-e7c415620328 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:35.452679 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-927a5fa6-ee73-4a50-9dd8-e7c415620328 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:35.698501 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-56979d5d-dc4a-4108-8c54-253af63b61bf tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:35.707484 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-927a5fa6-ee73-4a50-9dd8-e7c415620328 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:35.713342 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-56979d5d-dc4a-4108-8c54-253af63b61bf tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.417168 Dec 20 09:29:35.718607 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 100/215] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:35 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:35.718746 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-927a5fa6-ee73-4a50-9dd8-e7c415620328 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1553 microversion: 2.1 time: 0.278320 Dec 20 09:29:35.718746 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 116/216] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:35 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1553 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:35.766301 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-21cb5d8f-384b-4de5-84d7-4d62a7b352d7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:35.767270 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-21cb5d8f-384b-4de5-84d7-4d62a7b352d7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:35.773148 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-21cb5d8f-384b-4de5-84d7-4d62a7b352d7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:35.773600 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-21cb5d8f-384b-4de5-84d7-4d62a7b352d7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:35.774390 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-21cb5d8f-384b-4de5-84d7-4d62a7b352d7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:35.774822 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-21cb5d8f-384b-4de5-84d7-4d62a7b352d7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:35.912699 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-21cb5d8f-384b-4de5-84d7-4d62a7b352d7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 21971 microversion: 2.20 time: 0.149695 Dec 20 09:29:35.917951 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 101/217] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:35 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 21971 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:29:36.290766 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0a3037a4-c39c-4209-831a-c1cd85090531 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:36.291377 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0a3037a4-c39c-4209-831a-c1cd85090531 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:36.298159 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0a3037a4-c39c-4209-831a-c1cd85090531 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:36.298601 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0a3037a4-c39c-4209-831a-c1cd85090531 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:36.299560 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0a3037a4-c39c-4209-831a-c1cd85090531 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:36.300163 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0a3037a4-c39c-4209-831a-c1cd85090531 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:36.459674 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-0a3037a4-c39c-4209-831a-c1cd85090531 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:36.469037 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0a3037a4-c39c-4209-831a-c1cd85090531 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.182600 Dec 20 09:29:36.470133 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 117/218] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:36 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:36.733407 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b4264b9e-1206-45bc-9e98-321ba4fcb56b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:36.734407 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b4264b9e-1206-45bc-9e98-321ba4fcb56b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:36.737972 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-aef9620a-55e1-4892-80c5-72559bfe4b8f tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:36.738929 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-aef9620a-55e1-4892-80c5-72559bfe4b8f tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:36.741397 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b4264b9e-1206-45bc-9e98-321ba4fcb56b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:36.749665 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b4264b9e-1206-45bc-9e98-321ba4fcb56b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:36.749665 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b4264b9e-1206-45bc-9e98-321ba4fcb56b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:36.749665 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b4264b9e-1206-45bc-9e98-321ba4fcb56b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:36.749970 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-aef9620a-55e1-4892-80c5-72559bfe4b8f tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:36.749970 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-aef9620a-55e1-4892-80c5-72559bfe4b8f tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:36.749970 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-aef9620a-55e1-4892-80c5-72559bfe4b8f tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:36.749970 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-aef9620a-55e1-4892-80c5-72559bfe4b8f tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:36.953993 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b4264b9e-1206-45bc-9e98-321ba4fcb56b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:36.971266 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-aef9620a-55e1-4892-80c5-72559bfe4b8f tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:36.973520 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b4264b9e-1206-45bc-9e98-321ba4fcb56b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1314 microversion: 2.1 time: 0.246393 Dec 20 09:29:36.982118 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-aef9620a-55e1-4892-80c5-72559bfe4b8f tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1553 microversion: 2.1 time: 0.251735 Dec 20 09:29:36.983056 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 118/219] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:36 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1553 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:36.986844 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 102/220] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:36 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:36.996505 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0e6abbdd-4a0a-4001-ac7d-dd27edc38a8b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:36.997977 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0e6abbdd-4a0a-4001-ac7d-dd27edc38a8b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:37.005426 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0e6abbdd-4a0a-4001-ac7d-dd27edc38a8b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:37.006052 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0e6abbdd-4a0a-4001-ac7d-dd27edc38a8b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:37.007023 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0e6abbdd-4a0a-4001-ac7d-dd27edc38a8b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:37.007446 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0e6abbdd-4a0a-4001-ac7d-dd27edc38a8b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:37.128989 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0e6abbdd-4a0a-4001-ac7d-dd27edc38a8b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 22974 microversion: 2.20 time: 0.143043 Dec 20 09:29:37.130437 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 119/221] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:36 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 22974 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:29:37.487783 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-617d408c-2590-4526-99b6-703ca6b1a073 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:37.488590 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-617d408c-2590-4526-99b6-703ca6b1a073 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:37.497578 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-617d408c-2590-4526-99b6-703ca6b1a073 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:37.498186 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-617d408c-2590-4526-99b6-703ca6b1a073 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:37.499176 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-617d408c-2590-4526-99b6-703ca6b1a073 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:37.499841 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-617d408c-2590-4526-99b6-703ca6b1a073 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:37.527574 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-c6cb052a-23cd-4911-87cd-10d0bf882dfc req-406f9f14-84d6-4dac-8c34-00d549ed0e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632d2ff5-8fa8-4c1f-8bf0-de64b20de339", "name": "network-vif-deleted", "tag": "ab78a4d5-9785-4d8f-a076-dcb2076e8cb1"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:37.529145 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:29:37.529145 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:29:37.536866 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-c6cb052a-23cd-4911-87cd-10d0bf882dfc req-406f9f14-84d6-4dac-8c34-00d549ed0e75 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:37.537398 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-c6cb052a-23cd-4911-87cd-10d0bf882dfc req-406f9f14-84d6-4dac-8c34-00d549ed0e75 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:37.549802 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-c6cb052a-23cd-4911-87cd-10d0bf882dfc req-406f9f14-84d6-4dac-8c34-00d549ed0e75 service nova] Creating event network-vif-deleted:ab78a4d5-9785-4d8f-a076-dcb2076e8cb1 for instance 632d2ff5-8fa8-4c1f-8bf0-de64b20de339 on hv-cinder-81908 Dec 20 09:29:37.554645 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-c6cb052a-23cd-4911-87cd-10d0bf882dfc req-406f9f14-84d6-4dac-8c34-00d549ed0e75 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032398 Dec 20 09:29:37.560094 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 120/222] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:29:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:29:37.670004 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-617d408c-2590-4526-99b6-703ca6b1a073 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:37.677703 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-617d408c-2590-4526-99b6-703ca6b1a073 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.195135 Dec 20 09:29:37.678516 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 103/223] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:37 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:37.999187 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-2a021054-89d3-453d-88e3-14e30343d07b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:37.999929 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-2a021054-89d3-453d-88e3-14e30343d07b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:38.006453 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2a021054-89d3-453d-88e3-14e30343d07b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:38.006904 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2a021054-89d3-453d-88e3-14e30343d07b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:38.007726 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2a021054-89d3-453d-88e3-14e30343d07b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:38.008164 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2a021054-89d3-453d-88e3-14e30343d07b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:38.014287 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-cc3d9445-d9ae-435f-8b4a-e80c2accaffb tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:38.016110 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-cc3d9445-d9ae-435f-8b4a-e80c2accaffb tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:38.029598 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cc3d9445-d9ae-435f-8b4a-e80c2accaffb tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:38.032406 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cc3d9445-d9ae-435f-8b4a-e80c2accaffb tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:38.032406 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cc3d9445-d9ae-435f-8b4a-e80c2accaffb tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:38.032406 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cc3d9445-d9ae-435f-8b4a-e80c2accaffb tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:38.124573 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-2a021054-89d3-453d-88e3-14e30343d07b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:38.135464 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-2a021054-89d3-453d-88e3-14e30343d07b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1345 microversion: 2.1 time: 0.140533 Dec 20 09:29:38.136449 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 121/224] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:37 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1345 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:38.148984 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-69620c50-9d84-4a07-be45-e0db97a3102f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:38.151801 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-69620c50-9d84-4a07-be45-e0db97a3102f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:38.157965 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-69620c50-9d84-4a07-be45-e0db97a3102f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:38.158504 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-69620c50-9d84-4a07-be45-e0db97a3102f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:38.159410 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-69620c50-9d84-4a07-be45-e0db97a3102f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:38.160045 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-69620c50-9d84-4a07-be45-e0db97a3102f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:38.257664 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-69620c50-9d84-4a07-be45-e0db97a3102f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 23596 microversion: 2.20 time: 0.117414 Dec 20 09:29:38.263017 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 122/225] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:38 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 23596 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:29:38.280203 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-cc3d9445-d9ae-435f-8b4a-e80c2accaffb tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:38.288094 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-cc3d9445-d9ae-435f-8b4a-e80c2accaffb tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1498 microversion: 2.1 time: 0.278367 Dec 20 09:29:38.293884 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 104/226] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:38 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1498 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:38.694876 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c45fecd4-6d4c-4096-800d-9db109980172 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:38.695588 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c45fecd4-6d4c-4096-800d-9db109980172 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:38.709734 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c45fecd4-6d4c-4096-800d-9db109980172 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:38.709734 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c45fecd4-6d4c-4096-800d-9db109980172 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:38.709734 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c45fecd4-6d4c-4096-800d-9db109980172 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:38.709734 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c45fecd4-6d4c-4096-800d-9db109980172 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:38.839615 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-c45fecd4-6d4c-4096-800d-9db109980172 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:38.847529 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c45fecd4-6d4c-4096-800d-9db109980172 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.156835 Dec 20 09:29:38.848120 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 123/227] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:38 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:39.153821 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-7a4a257a-78a1-414d-a717-dad5fcb00bad tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:39.154431 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-7a4a257a-78a1-414d-a717-dad5fcb00bad tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:39.160467 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7a4a257a-78a1-414d-a717-dad5fcb00bad tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:39.161342 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7a4a257a-78a1-414d-a717-dad5fcb00bad tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:39.161725 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7a4a257a-78a1-414d-a717-dad5fcb00bad tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:39.162167 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7a4a257a-78a1-414d-a717-dad5fcb00bad tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:39.193946 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7a4a257a-78a1-414d-a717-dad5fcb00bad tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:39.194402 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7a4a257a-78a1-414d-a717-dad5fcb00bad tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:39.194849 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.objects.instance [None req-7a4a257a-78a1-414d-a717-dad5fcb00bad tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lazy-loading 'fault' on Instance uuid 632d2ff5-8fa8-4c1f-8bf0-de64b20de339 {{(pid=116675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:29:39.246471 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-7a4a257a-78a1-414d-a717-dad5fcb00bad tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a951df3654f0452d9bbf88a595fd18f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80def36911934a13be751381aa024b36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:39.255196 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-7a4a257a-78a1-414d-a717-dad5fcb00bad tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 200 len: 1350 microversion: 2.1 time: 0.107057 Dec 20 09:29:39.256172 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 105/228] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:39 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 1350 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:39.270665 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-97a05eff-a380-4fe0-9c37-3e1aa3b009a8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:39.272287 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-97a05eff-a380-4fe0-9c37-3e1aa3b009a8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:39.278773 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-97a05eff-a380-4fe0-9c37-3e1aa3b009a8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:39.279373 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-97a05eff-a380-4fe0-9c37-3e1aa3b009a8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:39.280289 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-97a05eff-a380-4fe0-9c37-3e1aa3b009a8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:39.280710 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-97a05eff-a380-4fe0-9c37-3e1aa3b009a8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:39.383606 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-97a05eff-a380-4fe0-9c37-3e1aa3b009a8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 24443 microversion: 2.20 time: 0.116738 Dec 20 09:29:39.384789 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 124/229] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:39 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 24443 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:29:39.864252 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-5bc9fd57-1ca4-4dde-bd70-ccc1ef65dff2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:39.864864 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-5bc9fd57-1ca4-4dde-bd70-ccc1ef65dff2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:39.878364 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5bc9fd57-1ca4-4dde-bd70-ccc1ef65dff2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:39.879124 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5bc9fd57-1ca4-4dde-bd70-ccc1ef65dff2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:39.879973 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5bc9fd57-1ca4-4dde-bd70-ccc1ef65dff2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:39.880632 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5bc9fd57-1ca4-4dde-bd70-ccc1ef65dff2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:40.023254 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-5bc9fd57-1ca4-4dde-bd70-ccc1ef65dff2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:40.032991 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-5bc9fd57-1ca4-4dde-bd70-ccc1ef65dff2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.171807 Dec 20 09:29:40.042623 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 106/230] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:39 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:40.093769 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-22cf7e9c-6828-40e2-adad-e8d6eeea77bd tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:40.094485 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-22cf7e9c-6828-40e2-adad-e8d6eeea77bd tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:40.100933 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-22cf7e9c-6828-40e2-adad-e8d6eeea77bd tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:40.105927 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-22cf7e9c-6828-40e2-adad-e8d6eeea77bd tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:40.105927 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-22cf7e9c-6828-40e2-adad-e8d6eeea77bd tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:40.105927 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-22cf7e9c-6828-40e2-adad-e8d6eeea77bd tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:40.127304 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-22cf7e9c-6828-40e2-adad-e8d6eeea77bd tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Going to try to terminate instance {{(pid=116674) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 09:29:40.281325 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-52879e58-5a84-4af9-b332-6b7f291ff15b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:40.282441 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-52879e58-5a84-4af9-b332-6b7f291ff15b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:40.290078 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-52879e58-5a84-4af9-b332-6b7f291ff15b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:40.291184 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-52879e58-5a84-4af9-b332-6b7f291ff15b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:40.292087 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-52879e58-5a84-4af9-b332-6b7f291ff15b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:40.294096 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-52879e58-5a84-4af9-b332-6b7f291ff15b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:40.308854 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-52879e58-5a84-4af9-b332-6b7f291ff15b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] HTTP exception thrown: Instance 632d2ff5-8fa8-4c1f-8bf0-de64b20de339 could not be found. Dec 20 09:29:40.309442 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-52879e58-5a84-4af9-b332-6b7f291ff15b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Returning 404 to user: Instance 632d2ff5-8fa8-4c1f-8bf0-de64b20de339 could not be found. {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:29:40.310256 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-52879e58-5a84-4af9-b332-6b7f291ff15b tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 404 len: 111 microversion: 2.1 time: 0.032964 Dec 20 09:29:40.314756 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 107/231] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:40 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:29:40.395684 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0195686b-08f3-458e-8e25-9c633d539ce0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:40.396544 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0195686b-08f3-458e-8e25-9c633d539ce0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:40.403083 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0195686b-08f3-458e-8e25-9c633d539ce0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:40.403763 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0195686b-08f3-458e-8e25-9c633d539ce0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:40.404711 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0195686b-08f3-458e-8e25-9c633d539ce0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:40.405304 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0195686b-08f3-458e-8e25-9c633d539ce0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:40.428253 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-22cf7e9c-6828-40e2-adad-e8d6eeea77bd tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 204 len: 0 microversion: 2.1 time: 0.340462 Dec 20 09:29:40.429705 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 125/232] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 20 09:29:40 2021] DELETE /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 09:29:40.443303 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4028d7cd-4577-4ca8-8e46-ccf43ee33e5b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:40.444417 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-4028d7cd-4577-4ca8-8e46-ccf43ee33e5b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:40.450725 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4028d7cd-4577-4ca8-8e46-ccf43ee33e5b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:40.451200 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4028d7cd-4577-4ca8-8e46-ccf43ee33e5b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:40.452024 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4028d7cd-4577-4ca8-8e46-ccf43ee33e5b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:40.452455 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4028d7cd-4577-4ca8-8e46-ccf43ee33e5b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:40.512580 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0195686b-08f3-458e-8e25-9c633d539ce0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 25000 microversion: 2.20 time: 0.120448 Dec 20 09:29:40.513787 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 108/233] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:40 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 25000 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:29:40.523405 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-76fbc499-3942-410b-9d15-fa4c32f53ddf tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:40.524775 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-76fbc499-3942-410b-9d15-fa4c32f53ddf tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:40.533024 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-76fbc499-3942-410b-9d15-fa4c32f53ddf tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:40.533773 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-76fbc499-3942-410b-9d15-fa4c32f53ddf tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:40.534630 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-76fbc499-3942-410b-9d15-fa4c32f53ddf tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:40.535274 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-76fbc499-3942-410b-9d15-fa4c32f53ddf tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:40.549036 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-76fbc499-3942-410b-9d15-fa4c32f53ddf tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] HTTP exception thrown: Instance 632d2ff5-8fa8-4c1f-8bf0-de64b20de339 could not be found. Dec 20 09:29:40.549707 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-76fbc499-3942-410b-9d15-fa4c32f53ddf tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Returning 404 to user: Instance 632d2ff5-8fa8-4c1f-8bf0-de64b20de339 could not be found. {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:29:40.550453 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-76fbc499-3942-410b-9d15-fa4c32f53ddf tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035126 Dec 20 09:29:40.551008 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 109/234] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:29:40 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:29:40.601168 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-4028d7cd-4577-4ca8-8e46-ccf43ee33e5b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:40.608343 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-4028d7cd-4577-4ca8-8e46-ccf43ee33e5b tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1504 microversion: 2.1 time: 0.169772 Dec 20 09:29:40.608913 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 126/235] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:40 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:41.049855 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-5d7357a3-f479-4db9-8d46-2fa2a95848c3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:41.050806 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-5d7357a3-f479-4db9-8d46-2fa2a95848c3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:41.057376 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5d7357a3-f479-4db9-8d46-2fa2a95848c3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:41.057827 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5d7357a3-f479-4db9-8d46-2fa2a95848c3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:41.058615 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5d7357a3-f479-4db9-8d46-2fa2a95848c3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:41.059043 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5d7357a3-f479-4db9-8d46-2fa2a95848c3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:41.195617 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-5d7357a3-f479-4db9-8d46-2fa2a95848c3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:41.203161 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-5d7357a3-f479-4db9-8d46-2fa2a95848c3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.157040 Dec 20 09:29:41.203884 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 110/236] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:41 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:41.527682 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d91ee4e0-f86c-420d-bdd5-617da2f9e67e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:41.529645 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d91ee4e0-f86c-420d-bdd5-617da2f9e67e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:41.536621 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d91ee4e0-f86c-420d-bdd5-617da2f9e67e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:41.537101 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d91ee4e0-f86c-420d-bdd5-617da2f9e67e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:41.537944 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d91ee4e0-f86c-420d-bdd5-617da2f9e67e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:41.538538 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d91ee4e0-f86c-420d-bdd5-617da2f9e67e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:41.625962 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-03cd26d4-7e2c-40c3-948e-9e5246e6afe8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:41.627035 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-03cd26d4-7e2c-40c3-948e-9e5246e6afe8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:41.638526 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-03cd26d4-7e2c-40c3-948e-9e5246e6afe8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:41.638974 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-03cd26d4-7e2c-40c3-948e-9e5246e6afe8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:41.639817 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-03cd26d4-7e2c-40c3-948e-9e5246e6afe8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:41.640252 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-03cd26d4-7e2c-40c3-948e-9e5246e6afe8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:41.662925 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d91ee4e0-f86c-420d-bdd5-617da2f9e67e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 25644 microversion: 2.20 time: 0.140076 Dec 20 09:29:41.663707 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 127/237] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:41 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 25644 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:29:41.773921 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-03cd26d4-7e2c-40c3-948e-9e5246e6afe8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:41.781276 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-03cd26d4-7e2c-40c3-948e-9e5246e6afe8 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1504 microversion: 2.1 time: 0.159663 Dec 20 09:29:41.791463 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 111/238] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:41 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:41.976997 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d975e9cb-3f13-4bf1-8f50-73430e1b65ae tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:41.977656 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d975e9cb-3f13-4bf1-8f50-73430e1b65ae tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:41.984880 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d975e9cb-3f13-4bf1-8f50-73430e1b65ae tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:41.985410 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d975e9cb-3f13-4bf1-8f50-73430e1b65ae tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:41.986274 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d975e9cb-3f13-4bf1-8f50-73430e1b65ae tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:41.986783 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d975e9cb-3f13-4bf1-8f50-73430e1b65ae tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:42.001246 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.wsgi [None req-d975e9cb-3f13-4bf1-8f50-73430e1b65ae tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] HTTP exception thrown: Instance 632d2ff5-8fa8-4c1f-8bf0-de64b20de339 could not be found. Dec 20 09:29:42.001851 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d975e9cb-3f13-4bf1-8f50-73430e1b65ae tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Returning 404 to user: Instance 632d2ff5-8fa8-4c1f-8bf0-de64b20de339 could not be found. {{(pid=116674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:29:42.002681 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d975e9cb-3f13-4bf1-8f50-73430e1b65ae tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "DELETE /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 404 len: 111 microversion: 2.1 time: 0.030387 Dec 20 09:29:42.003503 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 128/239] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 20 09:29:41 2021] DELETE /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:29:42.020507 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-384eceae-db04-4e54-b66f-645cd8fa04e5 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:42.020507 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-384eceae-db04-4e54-b66f-645cd8fa04e5 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] [instance: 632d2ff5-8fa8-4c1f-8bf0-de64b20de339] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:42.020507 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-384eceae-db04-4e54-b66f-645cd8fa04e5 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:42.020507 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-384eceae-db04-4e54-b66f-645cd8fa04e5 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:42.020842 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-384eceae-db04-4e54-b66f-645cd8fa04e5 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:42.020842 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-384eceae-db04-4e54-b66f-645cd8fa04e5 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:42.034352 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-384eceae-db04-4e54-b66f-645cd8fa04e5 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] HTTP exception thrown: Instance 632d2ff5-8fa8-4c1f-8bf0-de64b20de339 could not be found. Dec 20 09:29:42.034984 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-384eceae-db04-4e54-b66f-645cd8fa04e5 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] Returning 404 to user: Instance 632d2ff5-8fa8-4c1f-8bf0-de64b20de339 could not be found. {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:29:42.035871 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-384eceae-db04-4e54-b66f-645cd8fa04e5 tempest-DeleteServersTestJSON-329555574 tempest-DeleteServersTestJSON-329555574-project] 10.222.0.62 "GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339" status: 404 len: 111 microversion: 2.1 time: 0.028091 Dec 20 09:29:42.036419 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 112/240] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:42 2021] GET /compute/v2.1/servers/632d2ff5-8fa8-4c1f-8bf0-de64b20de339 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:29:42.219463 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-459f81a9-ae50-4040-9fbf-76c5de362c32 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:42.220301 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-459f81a9-ae50-4040-9fbf-76c5de362c32 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:42.227166 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-459f81a9-ae50-4040-9fbf-76c5de362c32 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:42.227557 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-459f81a9-ae50-4040-9fbf-76c5de362c32 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:42.228452 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-459f81a9-ae50-4040-9fbf-76c5de362c32 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:42.228952 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-459f81a9-ae50-4040-9fbf-76c5de362c32 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:42.419094 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-459f81a9-ae50-4040-9fbf-76c5de362c32 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:42.427920 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-459f81a9-ae50-4040-9fbf-76c5de362c32 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.210917 Dec 20 09:29:42.428750 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 129/241] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:42 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:42.674307 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-49ca157b-7692-4d18-a27a-d66103e5b423 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:42.675228 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-49ca157b-7692-4d18-a27a-d66103e5b423 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:42.682215 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-49ca157b-7692-4d18-a27a-d66103e5b423 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:42.682664 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-49ca157b-7692-4d18-a27a-d66103e5b423 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:42.683448 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-49ca157b-7692-4d18-a27a-d66103e5b423 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:42.683905 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-49ca157b-7692-4d18-a27a-d66103e5b423 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:42.798247 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a92d2892-ea3e-46a3-8e20-bd85768f60e0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:42.798756 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a92d2892-ea3e-46a3-8e20-bd85768f60e0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:42.804990 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a92d2892-ea3e-46a3-8e20-bd85768f60e0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:42.805429 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a92d2892-ea3e-46a3-8e20-bd85768f60e0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:42.806901 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a92d2892-ea3e-46a3-8e20-bd85768f60e0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:42.807295 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a92d2892-ea3e-46a3-8e20-bd85768f60e0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:42.943388 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a92d2892-ea3e-46a3-8e20-bd85768f60e0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:42.950819 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a92d2892-ea3e-46a3-8e20-bd85768f60e0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1504 microversion: 2.1 time: 0.156272 Dec 20 09:29:42.951535 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 130/242] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:42 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:43.444525 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-52c2cd6b-a335-42c1-b476-de0ab0239852 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:43.445125 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-52c2cd6b-a335-42c1-b476-de0ab0239852 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:43.451928 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-52c2cd6b-a335-42c1-b476-de0ab0239852 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:43.452372 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-52c2cd6b-a335-42c1-b476-de0ab0239852 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:43.453140 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-52c2cd6b-a335-42c1-b476-de0ab0239852 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:43.453570 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-52c2cd6b-a335-42c1-b476-de0ab0239852 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:43.592665 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-52c2cd6b-a335-42c1-b476-de0ab0239852 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:43.599983 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-52c2cd6b-a335-42c1-b476-de0ab0239852 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.159055 Dec 20 09:29:43.600546 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 131/243] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:43 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:43.967873 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-37aa2639-0e7b-4285-aa59-dc8dd3c2bf34 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:43.968583 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-37aa2639-0e7b-4285-aa59-dc8dd3c2bf34 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:43.974664 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37aa2639-0e7b-4285-aa59-dc8dd3c2bf34 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:43.975100 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37aa2639-0e7b-4285-aa59-dc8dd3c2bf34 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:43.975898 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37aa2639-0e7b-4285-aa59-dc8dd3c2bf34 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:43.976323 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37aa2639-0e7b-4285-aa59-dc8dd3c2bf34 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:44.112012 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-37aa2639-0e7b-4285-aa59-dc8dd3c2bf34 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:44.120350 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-37aa2639-0e7b-4285-aa59-dc8dd3c2bf34 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1504 microversion: 2.1 time: 0.156151 Dec 20 09:29:44.120921 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 132/244] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:43 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:44.616978 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-cf999a8c-35c5-4ad1-adaa-4697593b4bf2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:44.617589 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-cf999a8c-35c5-4ad1-adaa-4697593b4bf2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:44.623338 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cf999a8c-35c5-4ad1-adaa-4697593b4bf2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:44.623830 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cf999a8c-35c5-4ad1-adaa-4697593b4bf2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:44.624608 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cf999a8c-35c5-4ad1-adaa-4697593b4bf2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:44.625048 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cf999a8c-35c5-4ad1-adaa-4697593b4bf2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:44.764248 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-cf999a8c-35c5-4ad1-adaa-4697593b4bf2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:44.777535 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-cf999a8c-35c5-4ad1-adaa-4697593b4bf2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.163919 Dec 20 09:29:44.778562 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 133/245] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:44 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:45.137943 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-11e023e7-4e03-41a9-9c0d-bd5c0ca4639d tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:45.138705 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-11e023e7-4e03-41a9-9c0d-bd5c0ca4639d tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:45.144880 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-11e023e7-4e03-41a9-9c0d-bd5c0ca4639d tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:45.149191 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-11e023e7-4e03-41a9-9c0d-bd5c0ca4639d tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:45.149191 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-11e023e7-4e03-41a9-9c0d-bd5c0ca4639d tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:45.149191 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-11e023e7-4e03-41a9-9c0d-bd5c0ca4639d tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:45.278525 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-11e023e7-4e03-41a9-9c0d-bd5c0ca4639d tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:45.286114 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-11e023e7-4e03-41a9-9c0d-bd5c0ca4639d tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1504 microversion: 2.1 time: 0.152279 Dec 20 09:29:45.286690 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 134/246] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:45 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:45.799595 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b67e752e-ba33-4c3f-8056-cdca6ffa55a0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:45.800233 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b67e752e-ba33-4c3f-8056-cdca6ffa55a0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:45.807870 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b67e752e-ba33-4c3f-8056-cdca6ffa55a0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:45.808409 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b67e752e-ba33-4c3f-8056-cdca6ffa55a0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:45.809554 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b67e752e-ba33-4c3f-8056-cdca6ffa55a0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:45.809986 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b67e752e-ba33-4c3f-8056-cdca6ffa55a0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:45.945345 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b67e752e-ba33-4c3f-8056-cdca6ffa55a0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:45.952623 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b67e752e-ba33-4c3f-8056-cdca6ffa55a0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.156791 Dec 20 09:29:45.953181 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 135/247] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:45 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:46.063469 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-dac84c57-fac2-463d-9c8d-430655708667 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1367234882", "imageRef": "6f828f0b-c445-46a5-9960-492746785ef3", "flavorRef": "452", "networks": [{"uuid": "eda8d65d-a28a-4b39-afdf-98df1672c489"}]}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:46.111640 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.network.neutron [None req-dac84c57-fac2-463d-9c8d-430655708667 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] validate_networks() for [('eda8d65d-a28a-4b39-afdf-98df1672c489', None, None, None, None, None)] {{(pid=116674) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 09:29:46.627086 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-dac84c57-fac2-463d-9c8d-430655708667 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Flavor limits 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 09:29:46.627086 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-dac84c57-fac2-463d-9c8d-430655708667 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Image limits 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 09:29:46.627086 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-dac84c57-fac2-463d-9c8d-430655708667 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Flavor pref 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 09:29:46.627086 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-dac84c57-fac2-463d-9c8d-430655708667 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Image pref 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 09:29:46.627086 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-dac84c57-fac2-463d-9c8d-430655708667 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 09:29:46.629009 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dac84c57-fac2-463d-9c8d-430655708667 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:46.629009 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dac84c57-fac2-463d-9c8d-430655708667 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:46.629009 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dac84c57-fac2-463d-9c8d-430655708667 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:46.629009 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dac84c57-fac2-463d-9c8d-430655708667 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:46.630329 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-49ca157b-7692-4d18-a27a-d66103e5b423 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 27496 microversion: 2.20 time: 3.789579 Dec 20 09:29:46.630329 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 113/248] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:42 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 27496 bytes in 3791 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:29:46.630329 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a482ea8f-4af4-4396-8d83-479c9cc04e7e tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:46.630329 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a482ea8f-4af4-4396-8d83-479c9cc04e7e tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:46.630329 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a482ea8f-4af4-4396-8d83-479c9cc04e7e tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:46.630975 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a482ea8f-4af4-4396-8d83-479c9cc04e7e tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:46.630975 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a482ea8f-4af4-4396-8d83-479c9cc04e7e tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:46.630975 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a482ea8f-4af4-4396-8d83-479c9cc04e7e tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:46.631203 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-dac84c57-fac2-463d-9c8d-430655708667 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Getting quotas for project 24634d5b4d5a42479f08bfb638cdd78d. Resources: {'ram', 'cores', 'instances'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:29:46.631203 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-dac84c57-fac2-463d-9c8d-430655708667 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Getting quotas for user 10a6cc51b90e45d5a484e403dbbab488 and project 24634d5b4d5a42479f08bfb638cdd78d. Resources: {'ram', 'cores', 'instances'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:29:46.631203 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-dac84c57-fac2-463d-9c8d-430655708667 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Going to run 1 instances... {{(pid=116674) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 09:29:46.631203 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-dac84c57-fac2-463d-9c8d-430655708667 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f828f0b-c445-46a5-9960-492746785ef3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 09:29:46.631524 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a482ea8f-4af4-4396-8d83-479c9cc04e7e tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:46.631524 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a482ea8f-4af4-4396-8d83-479c9cc04e7e tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1504 microversion: 2.1 time: 0.151082 Dec 20 09:29:46.631524 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 114/249] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:46 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:46.719739 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-dac84c57-fac2-463d-9c8d-430655708667 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765509 Dec 20 09:29:46.720382 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 136/250] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 20 09:29:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 09:29:46.730780 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-562831b9-f89a-49a0-877e-5d8cd070dbfb tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:46.731393 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-562831b9-f89a-49a0-877e-5d8cd070dbfb tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:46.782713 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-562831b9-f89a-49a0-877e-5d8cd070dbfb tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:46.791547 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-562831b9-f89a-49a0-877e-5d8cd070dbfb tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1218 microversion: 2.1 time: 0.065012 Dec 20 09:29:46.792205 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 115/251] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:46 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:46.968838 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1b9e41f8-2143-49e7-8f1b-45bbf65cdae8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:46.969452 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-1b9e41f8-2143-49e7-8f1b-45bbf65cdae8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:46.975600 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1b9e41f8-2143-49e7-8f1b-45bbf65cdae8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:46.976077 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1b9e41f8-2143-49e7-8f1b-45bbf65cdae8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:46.977268 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1b9e41f8-2143-49e7-8f1b-45bbf65cdae8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:46.977727 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1b9e41f8-2143-49e7-8f1b-45bbf65cdae8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:47.113621 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1b9e41f8-2143-49e7-8f1b-45bbf65cdae8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:47.120822 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1b9e41f8-2143-49e7-8f1b-45bbf65cdae8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.155718 Dec 20 09:29:47.121390 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 137/252] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:46 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:47.472405 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e2fdfa9d-9f05-4c25-87a8-17f48f3e171a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:47.473618 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e2fdfa9d-9f05-4c25-87a8-17f48f3e171a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:47.480554 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e2fdfa9d-9f05-4c25-87a8-17f48f3e171a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:47.481651 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e2fdfa9d-9f05-4c25-87a8-17f48f3e171a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:47.481848 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e2fdfa9d-9f05-4c25-87a8-17f48f3e171a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:47.482251 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e2fdfa9d-9f05-4c25-87a8-17f48f3e171a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:47.630253 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-65bc49b2-154f-426b-b0d1-c3fef484f765 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:47.630787 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-65bc49b2-154f-426b-b0d1-c3fef484f765 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:47.637633 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-65bc49b2-154f-426b-b0d1-c3fef484f765 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:47.638077 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-65bc49b2-154f-426b-b0d1-c3fef484f765 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:47.638847 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-65bc49b2-154f-426b-b0d1-c3fef484f765 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:47.639271 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-65bc49b2-154f-426b-b0d1-c3fef484f765 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:47.769794 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-65bc49b2-154f-426b-b0d1-c3fef484f765 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:47.777532 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-65bc49b2-154f-426b-b0d1-c3fef484f765 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1504 microversion: 2.1 time: 0.151274 Dec 20 09:29:47.778199 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 138/253] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:47 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:47.808334 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4229b685-4630-4672-9c69-0e5eb4a83cc3 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:47.808931 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-4229b685-4630-4672-9c69-0e5eb4a83cc3 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:47.814637 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4229b685-4630-4672-9c69-0e5eb4a83cc3 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:47.815084 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4229b685-4630-4672-9c69-0e5eb4a83cc3 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:47.815896 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4229b685-4630-4672-9c69-0e5eb4a83cc3 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:47.816330 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4229b685-4630-4672-9c69-0e5eb4a83cc3 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:47.873096 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-4229b685-4630-4672-9c69-0e5eb4a83cc3 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:47.880524 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-4229b685-4630-4672-9c69-0e5eb4a83cc3 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1222 microversion: 2.1 time: 0.076041 Dec 20 09:29:47.881024 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 139/254] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:47 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1222 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:47.934470 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e2fdfa9d-9f05-4c25-87a8-17f48f3e171a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 27794 microversion: 2.20 time: 0.465678 Dec 20 09:29:47.935512 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 116/255] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:47 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 27794 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:29:48.138749 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c715b1fd-e8e5-4a02-ae54-09c202915a96 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:48.139554 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c715b1fd-e8e5-4a02-ae54-09c202915a96 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:48.145903 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c715b1fd-e8e5-4a02-ae54-09c202915a96 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:48.146351 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c715b1fd-e8e5-4a02-ae54-09c202915a96 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:48.147124 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c715b1fd-e8e5-4a02-ae54-09c202915a96 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:48.147551 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c715b1fd-e8e5-4a02-ae54-09c202915a96 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:48.508525 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-c715b1fd-e8e5-4a02-ae54-09c202915a96 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:48.518083 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c715b1fd-e8e5-4a02-ae54-09c202915a96 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.382918 Dec 20 09:29:48.519004 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 140/256] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:48 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:48.542581 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-0e6383ba-8d6d-4f0d-98ac-4f9ce9286ea5 req-ccbf22b2-efef-447a-8720-237fea6cbf0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d4cec5f-091a-4dbf-8e38-aafb2b24f957", "name": "network-vif-deleted", "tag": "28297062-13cd-4a98-b825-64eed343639e"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:48.544420 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:29:48.544420 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:29:48.553331 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-0e6383ba-8d6d-4f0d-98ac-4f9ce9286ea5 req-ccbf22b2-efef-447a-8720-237fea6cbf0b service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:48.553867 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-0e6383ba-8d6d-4f0d-98ac-4f9ce9286ea5 req-ccbf22b2-efef-447a-8720-237fea6cbf0b service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:48.565972 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-0e6383ba-8d6d-4f0d-98ac-4f9ce9286ea5 req-ccbf22b2-efef-447a-8720-237fea6cbf0b service nova] Creating event network-vif-deleted:28297062-13cd-4a98-b825-64eed343639e for instance 5d4cec5f-091a-4dbf-8e38-aafb2b24f957 on hv-cinder-81908 Dec 20 09:29:48.571013 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-0e6383ba-8d6d-4f0d-98ac-4f9ce9286ea5 req-ccbf22b2-efef-447a-8720-237fea6cbf0b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033364 Dec 20 09:29:48.572027 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 117/257] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:29:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:29:48.794685 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ae0de9a2-2c47-4c04-829f-addcc6c860c5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:48.795696 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ae0de9a2-2c47-4c04-829f-addcc6c860c5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:48.802921 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ae0de9a2-2c47-4c04-829f-addcc6c860c5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:48.807591 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ae0de9a2-2c47-4c04-829f-addcc6c860c5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:48.807591 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ae0de9a2-2c47-4c04-829f-addcc6c860c5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:48.807591 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ae0de9a2-2c47-4c04-829f-addcc6c860c5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:48.866712 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ae0de9a2-2c47-4c04-829f-addcc6c860c5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:48.874538 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ae0de9a2-2c47-4c04-829f-addcc6c860c5 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 200 len: 1299 microversion: 2.1 time: 0.084181 Dec 20 09:29:48.875286 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 141/258] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:48 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:48.897746 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-5e435432-4e25-4e06-8466-3eb67a9766b1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:48.898524 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-5e435432-4e25-4e06-8466-3eb67a9766b1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:48.905097 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5e435432-4e25-4e06-8466-3eb67a9766b1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:48.905602 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5e435432-4e25-4e06-8466-3eb67a9766b1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:48.906375 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5e435432-4e25-4e06-8466-3eb67a9766b1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:48.906819 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5e435432-4e25-4e06-8466-3eb67a9766b1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:48.948501 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d07b6166-d726-43f1-b33e-db6a9d76749b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:48.949470 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d07b6166-d726-43f1-b33e-db6a9d76749b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:48.955379 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d07b6166-d726-43f1-b33e-db6a9d76749b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:48.961702 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d07b6166-d726-43f1-b33e-db6a9d76749b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:48.961702 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d07b6166-d726-43f1-b33e-db6a9d76749b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:48.961702 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d07b6166-d726-43f1-b33e-db6a9d76749b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:48.967974 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-5e435432-4e25-4e06-8466-3eb67a9766b1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:48.976818 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-5e435432-4e25-4e06-8466-3eb67a9766b1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1278 microversion: 2.1 time: 0.083617 Dec 20 09:29:48.978301 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 118/259] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:48 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1278 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:49.046982 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d07b6166-d726-43f1-b33e-db6a9d76749b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 27794 microversion: 2.20 time: 0.101939 Dec 20 09:29:49.047896 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 142/260] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:48 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 27794 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:29:49.534652 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-276afa89-5d15-4625-ae82-dd1442de6af5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:49.535379 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-276afa89-5d15-4625-ae82-dd1442de6af5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:49.542659 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-276afa89-5d15-4625-ae82-dd1442de6af5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:49.543210 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-276afa89-5d15-4625-ae82-dd1442de6af5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:49.544220 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-276afa89-5d15-4625-ae82-dd1442de6af5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:49.544743 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-276afa89-5d15-4625-ae82-dd1442de6af5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:49.676010 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-276afa89-5d15-4625-ae82-dd1442de6af5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:49.684378 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-276afa89-5d15-4625-ae82-dd1442de6af5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.153043 Dec 20 09:29:49.690116 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 119/261] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:49 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:49.891746 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e16489cf-9a75-4809-8bdc-3334253e6318 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:49.892380 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e16489cf-9a75-4809-8bdc-3334253e6318 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 5d4cec5f-091a-4dbf-8e38-aafb2b24f957] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:49.907769 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e16489cf-9a75-4809-8bdc-3334253e6318 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:49.907769 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e16489cf-9a75-4809-8bdc-3334253e6318 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:49.907769 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e16489cf-9a75-4809-8bdc-3334253e6318 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:49.907769 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e16489cf-9a75-4809-8bdc-3334253e6318 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:49.916894 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.wsgi [None req-e16489cf-9a75-4809-8bdc-3334253e6318 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] HTTP exception thrown: Instance 5d4cec5f-091a-4dbf-8e38-aafb2b24f957 could not be found. Dec 20 09:29:49.917493 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e16489cf-9a75-4809-8bdc-3334253e6318 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Returning 404 to user: Instance 5d4cec5f-091a-4dbf-8e38-aafb2b24f957 could not be found. {{(pid=116674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:29:49.918318 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e16489cf-9a75-4809-8bdc-3334253e6318 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957" status: 404 len: 111 microversion: 2.1 time: 0.030700 Dec 20 09:29:49.918867 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 143/262] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:49 2021] GET /compute/v2.1/servers/5d4cec5f-091a-4dbf-8e38-aafb2b24f957 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:29:49.995305 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-11c50b53-690d-4341-8c5a-e6cb9a3628a1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:49.996009 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-11c50b53-690d-4341-8c5a-e6cb9a3628a1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:50.002212 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-11c50b53-690d-4341-8c5a-e6cb9a3628a1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:50.003150 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-11c50b53-690d-4341-8c5a-e6cb9a3628a1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:50.003979 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-11c50b53-690d-4341-8c5a-e6cb9a3628a1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:50.004407 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-11c50b53-690d-4341-8c5a-e6cb9a3628a1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:50.022576 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a1166445-e905-4c83-8002-aba893141795 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1136682454", "imageRef": "6f828f0b-c445-46a5-9960-492746785ef3", "flavorRef": "452", "networks": [{"uuid": "822cd373-b73e-4a6a-9b6d-45ec265552d1"}]}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:50.082439 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.network.neutron [None req-a1166445-e905-4c83-8002-aba893141795 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] validate_networks() for [('822cd373-b73e-4a6a-9b6d-45ec265552d1', None, None, None, None, None)] {{(pid=116674) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 09:29:50.226677 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-11c50b53-690d-4341-8c5a-e6cb9a3628a1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:50.234656 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-11c50b53-690d-4341-8c5a-e6cb9a3628a1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1318 microversion: 2.1 time: 0.242976 Dec 20 09:29:50.235896 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 120/263] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:49 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:50.241053 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b502749a-0523-4056-951d-7b94e5d13639 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:50.242113 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b502749a-0523-4056-951d-7b94e5d13639 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:50.248536 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b502749a-0523-4056-951d-7b94e5d13639 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:50.249073 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b502749a-0523-4056-951d-7b94e5d13639 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:50.249960 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b502749a-0523-4056-951d-7b94e5d13639 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:50.250618 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b502749a-0523-4056-951d-7b94e5d13639 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:50.411701 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b502749a-0523-4056-951d-7b94e5d13639 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 27921 microversion: 2.20 time: 0.174297 Dec 20 09:29:50.416728 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 121/264] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:50 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 27921 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:29:50.483541 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-a1166445-e905-4c83-8002-aba893141795 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Flavor limits 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 09:29:50.484090 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-a1166445-e905-4c83-8002-aba893141795 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Image limits 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 09:29:50.484684 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-a1166445-e905-4c83-8002-aba893141795 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Flavor pref 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 09:29:50.485003 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-a1166445-e905-4c83-8002-aba893141795 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Image pref 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 09:29:50.485382 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-a1166445-e905-4c83-8002-aba893141795 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 09:29:50.494024 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a1166445-e905-4c83-8002-aba893141795 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:50.494475 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a1166445-e905-4c83-8002-aba893141795 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:50.495288 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a1166445-e905-4c83-8002-aba893141795 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:50.495747 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a1166445-e905-4c83-8002-aba893141795 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:50.512141 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-a1166445-e905-4c83-8002-aba893141795 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Getting quotas for project c49197c6143140908f9feb71ef03ce54. Resources: {'ram', 'cores', 'instances'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:29:50.516070 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-a1166445-e905-4c83-8002-aba893141795 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Getting quotas for user 3b6621c6ec264cad9fe24e1dcfe49ee1 and project c49197c6143140908f9feb71ef03ce54. Resources: {'ram', 'cores', 'instances'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:29:50.527751 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a1166445-e905-4c83-8002-aba893141795 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Going to run 1 instances... {{(pid=116674) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 09:29:50.530470 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a1166445-e905-4c83-8002-aba893141795 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f828f0b-c445-46a5-9960-492746785ef3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 09:29:50.675579 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a1166445-e905-4c83-8002-aba893141795 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.656418 Dec 20 09:29:50.675579 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 144/265] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 20 09:29:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 20 09:29:50.682193 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-7fb70597-a9a7-46b0-8b23-04634048c6a8 req-93e78404-1447-4531-b983-3c499cd2d866 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f2bd5eb-b318-41f6-a143-65f3f05bd1d8", "tag": "6899c157-c762-49a5-ae5b-ee0327084337"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:50.685623 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:29:50.685623 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:29:50.697687 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-7fb70597-a9a7-46b0-8b23-04634048c6a8 req-93e78404-1447-4531-b983-3c499cd2d866 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:50.698912 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-7fb70597-a9a7-46b0-8b23-04634048c6a8 req-93e78404-1447-4531-b983-3c499cd2d866 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:50.704651 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-95d1f7c4-b302-446f-943a-e542f655f12c tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:50.705301 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-95d1f7c4-b302-446f-943a-e542f655f12c tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:50.725883 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-7fb70597-a9a7-46b0-8b23-04634048c6a8 req-93e78404-1447-4531-b983-3c499cd2d866 service nova] Creating event network-changed:6899c157-c762-49a5-ae5b-ee0327084337 for instance 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 on hv-cinder-81908 Dec 20 09:29:50.732304 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-7fb70597-a9a7-46b0-8b23-04634048c6a8 req-93e78404-1447-4531-b983-3c499cd2d866 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055439 Dec 20 09:29:50.734083 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 122/266] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:29:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:29:50.739410 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-5b542cf0-ef6d-4ef9-9719-531dae46b7b1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:50.748627 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-5b542cf0-ef6d-4ef9-9719-531dae46b7b1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:50.749582 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5b542cf0-ef6d-4ef9-9719-531dae46b7b1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:50.750017 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5b542cf0-ef6d-4ef9-9719-531dae46b7b1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:50.750744 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5b542cf0-ef6d-4ef9-9719-531dae46b7b1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:50.751176 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5b542cf0-ef6d-4ef9-9719-531dae46b7b1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:50.763588 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-95d1f7c4-b302-446f-943a-e542f655f12c tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:50.771257 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-95d1f7c4-b302-446f-943a-e542f655f12c tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1214 microversion: 2.1 time: 0.089510 Dec 20 09:29:50.771257 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 145/267] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:50 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:50.906136 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-5b542cf0-ef6d-4ef9-9719-531dae46b7b1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:50.914009 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-5b542cf0-ef6d-4ef9-9719-531dae46b7b1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.178525 Dec 20 09:29:50.914485 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 123/268] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:50 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:51.251984 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3fb4df79-a803-48fc-8325-179b39ce6fef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:51.252508 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-3fb4df79-a803-48fc-8325-179b39ce6fef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:51.258890 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3fb4df79-a803-48fc-8325-179b39ce6fef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:51.268863 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3fb4df79-a803-48fc-8325-179b39ce6fef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:51.268863 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3fb4df79-a803-48fc-8325-179b39ce6fef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:51.268863 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3fb4df79-a803-48fc-8325-179b39ce6fef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:51.392014 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3fb4df79-a803-48fc-8325-179b39ce6fef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:51.399108 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3fb4df79-a803-48fc-8325-179b39ce6fef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1318 microversion: 2.1 time: 0.150828 Dec 20 09:29:51.399676 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 146/269] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:51 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:51.424010 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c9ab28ab-55a1-428f-be09-29128d1e2f93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:51.424932 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c9ab28ab-55a1-428f-be09-29128d1e2f93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:51.432065 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9ab28ab-55a1-428f-be09-29128d1e2f93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:51.432515 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9ab28ab-55a1-428f-be09-29128d1e2f93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:51.433292 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9ab28ab-55a1-428f-be09-29128d1e2f93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:51.433728 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9ab28ab-55a1-428f-be09-29128d1e2f93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:51.786974 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f1ff6bae-1785-4d86-a4d7-46f37bd1e6ff tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:51.787717 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f1ff6bae-1785-4d86-a4d7-46f37bd1e6ff tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:51.794112 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f1ff6bae-1785-4d86-a4d7-46f37bd1e6ff tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:51.794637 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f1ff6bae-1785-4d86-a4d7-46f37bd1e6ff tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:51.795423 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f1ff6bae-1785-4d86-a4d7-46f37bd1e6ff tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:51.795896 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f1ff6bae-1785-4d86-a4d7-46f37bd1e6ff tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:51.853654 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f1ff6bae-1785-4d86-a4d7-46f37bd1e6ff tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:51.863067 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f1ff6bae-1785-4d86-a4d7-46f37bd1e6ff tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1218 microversion: 2.1 time: 0.079698 Dec 20 09:29:51.863913 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 147/270] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:51 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:51.930950 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-08a040ad-505c-4b4e-862c-d2f223ce486e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:51.931548 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-08a040ad-505c-4b4e-862c-d2f223ce486e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:51.937359 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-08a040ad-505c-4b4e-862c-d2f223ce486e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:51.937801 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-08a040ad-505c-4b4e-862c-d2f223ce486e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:51.938563 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-08a040ad-505c-4b4e-862c-d2f223ce486e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:51.938994 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-08a040ad-505c-4b4e-862c-d2f223ce486e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:52.070587 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-08a040ad-505c-4b4e-862c-d2f223ce486e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:52.078425 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-08a040ad-505c-4b4e-862c-d2f223ce486e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.151094 Dec 20 09:29:52.078929 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 148/271] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:51 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:52.415899 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-387b5e4a-0356-4e09-83be-4914e12b93e8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:52.416633 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-387b5e4a-0356-4e09-83be-4914e12b93e8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:52.422651 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-387b5e4a-0356-4e09-83be-4914e12b93e8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:52.423101 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-387b5e4a-0356-4e09-83be-4914e12b93e8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:52.423903 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-387b5e4a-0356-4e09-83be-4914e12b93e8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:52.424339 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-387b5e4a-0356-4e09-83be-4914e12b93e8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:52.564497 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-387b5e4a-0356-4e09-83be-4914e12b93e8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:52.571679 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-387b5e4a-0356-4e09-83be-4914e12b93e8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1318 microversion: 2.1 time: 0.159896 Dec 20 09:29:52.572261 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 149/272] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:52 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:52.880778 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-586968ff-c942-42e8-af26-dda2c65f5502 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:52.881385 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-586968ff-c942-42e8-af26-dda2c65f5502 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:52.887134 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-586968ff-c942-42e8-af26-dda2c65f5502 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:52.887816 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-586968ff-c942-42e8-af26-dda2c65f5502 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:52.889224 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-586968ff-c942-42e8-af26-dda2c65f5502 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:52.889224 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-586968ff-c942-42e8-af26-dda2c65f5502 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:52.946786 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-586968ff-c942-42e8-af26-dda2c65f5502 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:52.953810 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-586968ff-c942-42e8-af26-dda2c65f5502 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1218 microversion: 2.1 time: 0.077165 Dec 20 09:29:52.954370 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 150/273] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:52 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:53.093766 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-720aed02-aac7-4b0c-9950-0685577e48dd tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:53.094376 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-720aed02-aac7-4b0c-9950-0685577e48dd tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:53.100164 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-720aed02-aac7-4b0c-9950-0685577e48dd tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:53.100609 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-720aed02-aac7-4b0c-9950-0685577e48dd tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:53.101415 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-720aed02-aac7-4b0c-9950-0685577e48dd tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:53.101848 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-720aed02-aac7-4b0c-9950-0685577e48dd tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:53.233522 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-720aed02-aac7-4b0c-9950-0685577e48dd tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:53.241131 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-720aed02-aac7-4b0c-9950-0685577e48dd tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.150827 Dec 20 09:29:53.241704 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 151/274] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:53 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:53.588110 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-69c1d92a-da64-4418-85a7-a0bb9c7ad8dc tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:53.588707 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-69c1d92a-da64-4418-85a7-a0bb9c7ad8dc tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:53.594759 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-69c1d92a-da64-4418-85a7-a0bb9c7ad8dc tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:53.595195 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-69c1d92a-da64-4418-85a7-a0bb9c7ad8dc tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:53.595983 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-69c1d92a-da64-4418-85a7-a0bb9c7ad8dc tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:53.596410 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-69c1d92a-da64-4418-85a7-a0bb9c7ad8dc tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:53.724034 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-69c1d92a-da64-4418-85a7-a0bb9c7ad8dc tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:53.731184 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-69c1d92a-da64-4418-85a7-a0bb9c7ad8dc tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1318 microversion: 2.1 time: 0.146740 Dec 20 09:29:53.731754 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 152/275] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:53 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:53.969958 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3c61dbad-5068-4191-bd62-3b4564340b2a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:53.970986 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-3c61dbad-5068-4191-bd62-3b4564340b2a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:53.984761 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3c61dbad-5068-4191-bd62-3b4564340b2a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:53.984761 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3c61dbad-5068-4191-bd62-3b4564340b2a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:53.984761 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3c61dbad-5068-4191-bd62-3b4564340b2a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:53.984761 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3c61dbad-5068-4191-bd62-3b4564340b2a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:54.034409 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3c61dbad-5068-4191-bd62-3b4564340b2a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:54.041488 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3c61dbad-5068-4191-bd62-3b4564340b2a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1218 microversion: 2.1 time: 0.075129 Dec 20 09:29:54.042040 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 153/276] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:53 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:54.257405 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-93e85d9f-d3eb-4686-aa62-57b228e9a37b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:54.258003 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-93e85d9f-d3eb-4686-aa62-57b228e9a37b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:54.264367 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-93e85d9f-d3eb-4686-aa62-57b228e9a37b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:54.264805 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-93e85d9f-d3eb-4686-aa62-57b228e9a37b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:54.265567 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-93e85d9f-d3eb-4686-aa62-57b228e9a37b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:54.265996 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-93e85d9f-d3eb-4686-aa62-57b228e9a37b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:54.393565 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-93e85d9f-d3eb-4686-aa62-57b228e9a37b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:54.400791 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-93e85d9f-d3eb-4686-aa62-57b228e9a37b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.146907 Dec 20 09:29:54.401384 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 154/277] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:54 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:54.747851 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0f76a4c9-f9a3-4b1e-a8f4-3305681a030c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:54.748459 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0f76a4c9-f9a3-4b1e-a8f4-3305681a030c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:54.754882 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0f76a4c9-f9a3-4b1e-a8f4-3305681a030c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:54.755322 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0f76a4c9-f9a3-4b1e-a8f4-3305681a030c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:54.756117 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0f76a4c9-f9a3-4b1e-a8f4-3305681a030c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:54.756543 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0f76a4c9-f9a3-4b1e-a8f4-3305681a030c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:54.784101 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c9ab28ab-55a1-428f-be09-29128d1e2f93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 27921 microversion: 2.20 time: 3.363504 Dec 20 09:29:54.785137 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 124/278] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:51 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 27921 bytes in 3365 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:29:54.889650 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-0f76a4c9-f9a3-4b1e-a8f4-3305681a030c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:54.897818 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0f76a4c9-f9a3-4b1e-a8f4-3305681a030c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1318 microversion: 2.1 time: 0.153288 Dec 20 09:29:54.908123 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 155/279] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:54 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:55.058803 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f79fdb16-7b33-441d-9db4-e197f262c82c tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:55.059510 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f79fdb16-7b33-441d-9db4-e197f262c82c tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:55.066314 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f79fdb16-7b33-441d-9db4-e197f262c82c tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:55.066763 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f79fdb16-7b33-441d-9db4-e197f262c82c tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:55.067535 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f79fdb16-7b33-441d-9db4-e197f262c82c tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:55.067995 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f79fdb16-7b33-441d-9db4-e197f262c82c tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:55.125817 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f79fdb16-7b33-441d-9db4-e197f262c82c tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:55.133465 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f79fdb16-7b33-441d-9db4-e197f262c82c tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1210 microversion: 2.1 time: 0.079134 Dec 20 09:29:55.134621 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 125/280] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:55 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1210 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:55.417845 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b8ce8aaf-26be-4856-aa24-180ecce19f6e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:55.418478 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b8ce8aaf-26be-4856-aa24-180ecce19f6e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:55.424522 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b8ce8aaf-26be-4856-aa24-180ecce19f6e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:55.424973 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b8ce8aaf-26be-4856-aa24-180ecce19f6e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:55.425902 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b8ce8aaf-26be-4856-aa24-180ecce19f6e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:55.426483 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b8ce8aaf-26be-4856-aa24-180ecce19f6e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:55.566510 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b8ce8aaf-26be-4856-aa24-180ecce19f6e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:55.574251 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b8ce8aaf-26be-4856-aa24-180ecce19f6e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.160576 Dec 20 09:29:55.574965 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 156/281] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:55 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:55.795139 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2416bb7e-7019-41a6-a925-596b275c456b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:29:55.796068 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2416bb7e-7019-41a6-a925-596b275c456b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:55.802174 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2416bb7e-7019-41a6-a925-596b275c456b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:55.802613 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2416bb7e-7019-41a6-a925-596b275c456b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:55.803382 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2416bb7e-7019-41a6-a925-596b275c456b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:55.803842 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2416bb7e-7019-41a6-a925-596b275c456b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:55.914367 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-84145fd5-8514-469e-b737-c79f56a0e9ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:55.914973 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-84145fd5-8514-469e-b737-c79f56a0e9ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:55.921541 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84145fd5-8514-469e-b737-c79f56a0e9ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:55.921991 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84145fd5-8514-469e-b737-c79f56a0e9ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:55.922772 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84145fd5-8514-469e-b737-c79f56a0e9ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:55.923208 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84145fd5-8514-469e-b737-c79f56a0e9ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:56.054413 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-84145fd5-8514-469e-b737-c79f56a0e9ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:56.062763 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-84145fd5-8514-469e-b737-c79f56a0e9ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1318 microversion: 2.1 time: 0.152075 Dec 20 09:29:56.063317 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 157/282] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:55 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:56.150008 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-51730be4-d096-4c46-b534-8f6f568a1e39 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:56.150607 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-51730be4-d096-4c46-b534-8f6f568a1e39 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:56.156465 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-51730be4-d096-4c46-b534-8f6f568a1e39 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:56.156908 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-51730be4-d096-4c46-b534-8f6f568a1e39 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:56.157687 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-51730be4-d096-4c46-b534-8f6f568a1e39 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:56.158116 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-51730be4-d096-4c46-b534-8f6f568a1e39 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:56.214995 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-51730be4-d096-4c46-b534-8f6f568a1e39 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:56.222150 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-51730be4-d096-4c46-b534-8f6f568a1e39 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1266 microversion: 2.1 time: 0.075786 Dec 20 09:29:56.222708 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 158/283] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:56 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1266 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:56.590752 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-43e85881-6716-4322-872e-1f3e7af716a9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:56.591275 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-43e85881-6716-4322-872e-1f3e7af716a9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:56.597129 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-43e85881-6716-4322-872e-1f3e7af716a9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:56.597564 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-43e85881-6716-4322-872e-1f3e7af716a9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:56.598327 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-43e85881-6716-4322-872e-1f3e7af716a9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:56.598753 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-43e85881-6716-4322-872e-1f3e7af716a9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:56.728531 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-43e85881-6716-4322-872e-1f3e7af716a9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:56.736154 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-43e85881-6716-4322-872e-1f3e7af716a9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.149586 Dec 20 09:29:56.736722 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 159/284] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:56 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:57.080104 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e62701c3-7b18-4429-bb72-105c2703ea39 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:57.080754 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e62701c3-7b18-4429-bb72-105c2703ea39 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:57.086947 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e62701c3-7b18-4429-bb72-105c2703ea39 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:57.087399 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e62701c3-7b18-4429-bb72-105c2703ea39 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:57.088217 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e62701c3-7b18-4429-bb72-105c2703ea39 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:57.088655 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e62701c3-7b18-4429-bb72-105c2703ea39 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:57.220409 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e62701c3-7b18-4429-bb72-105c2703ea39 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:57.228213 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e62701c3-7b18-4429-bb72-105c2703ea39 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1318 microversion: 2.1 time: 0.151942 Dec 20 09:29:57.228797 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 160/285] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:57 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:57.238843 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1f31bcf2-f304-4f0c-ac2b-899169a48f90 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:57.239445 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-1f31bcf2-f304-4f0c-ac2b-899169a48f90 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:57.245030 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1f31bcf2-f304-4f0c-ac2b-899169a48f90 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:57.245479 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1f31bcf2-f304-4f0c-ac2b-899169a48f90 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:57.246252 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1f31bcf2-f304-4f0c-ac2b-899169a48f90 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:57.246693 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1f31bcf2-f304-4f0c-ac2b-899169a48f90 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:57.437183 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1f31bcf2-f304-4f0c-ac2b-899169a48f90 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:57.444388 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1f31bcf2-f304-4f0c-ac2b-899169a48f90 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1266 microversion: 2.1 time: 0.209045 Dec 20 09:29:57.444946 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 161/286] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:57 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:29:57.752523 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-2fdb6fb8-ff85-424d-a4aa-9ad58d9485b7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:57.753417 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-2fdb6fb8-ff85-424d-a4aa-9ad58d9485b7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:57.759774 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2fdb6fb8-ff85-424d-a4aa-9ad58d9485b7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:57.760224 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2fdb6fb8-ff85-424d-a4aa-9ad58d9485b7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:57.761001 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2fdb6fb8-ff85-424d-a4aa-9ad58d9485b7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:57.761438 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2fdb6fb8-ff85-424d-a4aa-9ad58d9485b7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:57.889229 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-2fdb6fb8-ff85-424d-a4aa-9ad58d9485b7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:57.896508 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-2fdb6fb8-ff85-424d-a4aa-9ad58d9485b7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.147613 Dec 20 09:29:57.897079 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 162/287] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:57 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:58.244307 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-082dd27a-9f8b-4d6e-b99c-5e0273eb2330 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:58.244920 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-082dd27a-9f8b-4d6e-b99c-5e0273eb2330 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:58.251256 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-082dd27a-9f8b-4d6e-b99c-5e0273eb2330 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:58.251721 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-082dd27a-9f8b-4d6e-b99c-5e0273eb2330 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:58.252519 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-082dd27a-9f8b-4d6e-b99c-5e0273eb2330 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:58.253214 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-082dd27a-9f8b-4d6e-b99c-5e0273eb2330 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:58.378471 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-082dd27a-9f8b-4d6e-b99c-5e0273eb2330 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:58.387047 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-082dd27a-9f8b-4d6e-b99c-5e0273eb2330 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1318 microversion: 2.1 time: 0.145544 Dec 20 09:29:58.387328 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 163/288] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:58 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:58.460976 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1079295b-2faf-4c8c-b5df-81cfff0dab08 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:58.461574 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-1079295b-2faf-4c8c-b5df-81cfff0dab08 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:58.467909 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1079295b-2faf-4c8c-b5df-81cfff0dab08 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:58.468348 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1079295b-2faf-4c8c-b5df-81cfff0dab08 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:58.469111 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1079295b-2faf-4c8c-b5df-81cfff0dab08 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:58.469539 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1079295b-2faf-4c8c-b5df-81cfff0dab08 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:58.527540 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1079295b-2faf-4c8c-b5df-81cfff0dab08 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:58.534542 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1079295b-2faf-4c8c-b5df-81cfff0dab08 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1266 microversion: 2.1 time: 0.077237 Dec 20 09:29:58.535093 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 164/289] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:58 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:58.913258 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0b4e33de-7359-49f0-b336-1e2d6aa1e814 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:58.913854 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0b4e33de-7359-49f0-b336-1e2d6aa1e814 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:58.919814 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0b4e33de-7359-49f0-b336-1e2d6aa1e814 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:58.920254 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0b4e33de-7359-49f0-b336-1e2d6aa1e814 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:58.921028 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0b4e33de-7359-49f0-b336-1e2d6aa1e814 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:58.921455 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0b4e33de-7359-49f0-b336-1e2d6aa1e814 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:59.053383 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-0b4e33de-7359-49f0-b336-1e2d6aa1e814 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:59.061211 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0b4e33de-7359-49f0-b336-1e2d6aa1e814 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.151574 Dec 20 09:29:59.061768 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 165/290] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:58 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:59.402799 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-53609355-a721-4dca-bb43-971e41f4a238 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:59.403480 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-53609355-a721-4dca-bb43-971e41f4a238 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:59.409792 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-53609355-a721-4dca-bb43-971e41f4a238 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:59.410735 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-53609355-a721-4dca-bb43-971e41f4a238 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:59.411007 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-53609355-a721-4dca-bb43-971e41f4a238 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:59.411467 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-53609355-a721-4dca-bb43-971e41f4a238 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:59.537377 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-53609355-a721-4dca-bb43-971e41f4a238 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:59.545182 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-53609355-a721-4dca-bb43-971e41f4a238 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1318 microversion: 2.1 time: 0.146453 Dec 20 09:29:59.545933 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 166/291] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:59 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:29:59.550939 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e4645180-c096-4417-ab91-50f176ae9f31 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:29:59.551542 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e4645180-c096-4417-ab91-50f176ae9f31 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:29:59.557078 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e4645180-c096-4417-ab91-50f176ae9f31 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:59.557521 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e4645180-c096-4417-ab91-50f176ae9f31 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:59.558299 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e4645180-c096-4417-ab91-50f176ae9f31 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:29:59.558736 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e4645180-c096-4417-ab91-50f176ae9f31 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:29:59.623259 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e4645180-c096-4417-ab91-50f176ae9f31 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:29:59.630561 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e4645180-c096-4417-ab91-50f176ae9f31 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1266 microversion: 2.1 time: 0.082983 Dec 20 09:29:59.631114 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 167/292] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:29:59 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:00.077736 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-147f82c4-30ba-495e-acd3-1cb867f016b1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:00.078342 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-147f82c4-30ba-495e-acd3-1cb867f016b1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:00.084270 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-147f82c4-30ba-495e-acd3-1cb867f016b1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:00.084728 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-147f82c4-30ba-495e-acd3-1cb867f016b1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:00.085504 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-147f82c4-30ba-495e-acd3-1cb867f016b1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:00.085943 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-147f82c4-30ba-495e-acd3-1cb867f016b1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:00.229762 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-147f82c4-30ba-495e-acd3-1cb867f016b1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:00.237879 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-147f82c4-30ba-495e-acd3-1cb867f016b1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.163747 Dec 20 09:30:00.238538 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 168/293] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:00 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:00.561947 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1c316726-42c8-4181-8118-60c50e3c6141 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:00.562569 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-1c316726-42c8-4181-8118-60c50e3c6141 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:00.568804 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1c316726-42c8-4181-8118-60c50e3c6141 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:00.569253 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1c316726-42c8-4181-8118-60c50e3c6141 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:00.570035 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1c316726-42c8-4181-8118-60c50e3c6141 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:00.570472 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1c316726-42c8-4181-8118-60c50e3c6141 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:00.696442 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1c316726-42c8-4181-8118-60c50e3c6141 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:00.703503 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1c316726-42c8-4181-8118-60c50e3c6141 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1318 microversion: 2.1 time: 0.145325 Dec 20 09:30:00.704103 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 169/294] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:00 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:00.708382 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-63f00cf2-a793-439b-95bd-403ae4ae2cca tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:00.708988 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-63f00cf2-a793-439b-95bd-403ae4ae2cca tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:00.714489 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-63f00cf2-a793-439b-95bd-403ae4ae2cca tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:00.714939 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-63f00cf2-a793-439b-95bd-403ae4ae2cca tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:00.715740 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-63f00cf2-a793-439b-95bd-403ae4ae2cca tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:00.716181 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-63f00cf2-a793-439b-95bd-403ae4ae2cca tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:00.773328 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-63f00cf2-a793-439b-95bd-403ae4ae2cca tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:00.780548 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-63f00cf2-a793-439b-95bd-403ae4ae2cca tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1266 microversion: 2.1 time: 0.075521 Dec 20 09:30:00.781109 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 170/295] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:00 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1266 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:01.254054 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-bea76ecd-9829-433c-9b20-724da4fcf54c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:01.254658 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-bea76ecd-9829-433c-9b20-724da4fcf54c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:01.261000 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bea76ecd-9829-433c-9b20-724da4fcf54c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:01.261442 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bea76ecd-9829-433c-9b20-724da4fcf54c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:01.262211 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bea76ecd-9829-433c-9b20-724da4fcf54c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:01.262724 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bea76ecd-9829-433c-9b20-724da4fcf54c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:01.381933 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2416bb7e-7019-41a6-a925-596b275c456b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28039 microversion: 2.20 time: 5.590280 Dec 20 09:30:01.382865 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 126/296] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:29:55 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28039 bytes in 5592 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:30:01.401112 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-bea76ecd-9829-433c-9b20-724da4fcf54c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:01.408481 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-bea76ecd-9829-433c-9b20-724da4fcf54c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.158230 Dec 20 09:30:01.409114 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 171/297] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:01 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:01.720221 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-140244ec-6c88-41df-9b81-d6e74226fc92 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:01.720928 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-140244ec-6c88-41df-9b81-d6e74226fc92 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:01.728557 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-140244ec-6c88-41df-9b81-d6e74226fc92 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:01.729007 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-140244ec-6c88-41df-9b81-d6e74226fc92 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:01.729789 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-140244ec-6c88-41df-9b81-d6e74226fc92 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:01.730225 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-140244ec-6c88-41df-9b81-d6e74226fc92 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:01.797763 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-805a94cc-86c3-407f-8b5e-0e9df5e0ec46 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:01.798378 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-805a94cc-86c3-407f-8b5e-0e9df5e0ec46 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:01.804506 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-805a94cc-86c3-407f-8b5e-0e9df5e0ec46 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:01.808531 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-805a94cc-86c3-407f-8b5e-0e9df5e0ec46 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:01.808531 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-805a94cc-86c3-407f-8b5e-0e9df5e0ec46 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:01.808531 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-805a94cc-86c3-407f-8b5e-0e9df5e0ec46 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:01.876822 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-805a94cc-86c3-407f-8b5e-0e9df5e0ec46 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:01.881752 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-140244ec-6c88-41df-9b81-d6e74226fc92 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:01.885340 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-805a94cc-86c3-407f-8b5e-0e9df5e0ec46 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1274 microversion: 2.1 time: 0.091395 Dec 20 09:30:01.886444 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 172/298] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:01 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:01.890114 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-140244ec-6c88-41df-9b81-d6e74226fc92 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1318 microversion: 2.1 time: 0.173801 Dec 20 09:30:01.890757 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 127/299] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:01 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:02.393532 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-417da0e3-a8f9-45a6-bd53-6a08d3683c41 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:02.394516 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-417da0e3-a8f9-45a6-bd53-6a08d3683c41 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:02.400899 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-417da0e3-a8f9-45a6-bd53-6a08d3683c41 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:02.401393 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-417da0e3-a8f9-45a6-bd53-6a08d3683c41 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:02.402142 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-417da0e3-a8f9-45a6-bd53-6a08d3683c41 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:02.402570 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-417da0e3-a8f9-45a6-bd53-6a08d3683c41 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:02.426031 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-fc342881-d4c6-4df2-b38a-3d0ad5a2ade3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:02.426776 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-fc342881-d4c6-4df2-b38a-3d0ad5a2ade3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:02.433648 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fc342881-d4c6-4df2-b38a-3d0ad5a2ade3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:02.436404 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fc342881-d4c6-4df2-b38a-3d0ad5a2ade3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:02.437290 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fc342881-d4c6-4df2-b38a-3d0ad5a2ade3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:02.437804 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fc342881-d4c6-4df2-b38a-3d0ad5a2ade3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:02.562895 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-417da0e3-a8f9-45a6-bd53-6a08d3683c41 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28039 microversion: 2.20 time: 0.172875 Dec 20 09:30:02.564663 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 173/300] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:30:02 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28039 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:30:02.583239 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-fc342881-d4c6-4df2-b38a-3d0ad5a2ade3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:02.591250 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-fc342881-d4c6-4df2-b38a-3d0ad5a2ade3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.168886 Dec 20 09:30:02.591850 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 128/301] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:02 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:02.903149 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f2e86814-00c1-4cfa-9f15-e02e7059ba8c tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:02.904084 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f2e86814-00c1-4cfa-9f15-e02e7059ba8c tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:02.909833 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6dabbaba-07ca-40f2-ae61-bfe15c3c75ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:02.909833 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6dabbaba-07ca-40f2-ae61-bfe15c3c75ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:02.911295 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f2e86814-00c1-4cfa-9f15-e02e7059ba8c tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:02.911852 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f2e86814-00c1-4cfa-9f15-e02e7059ba8c tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:02.912756 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f2e86814-00c1-4cfa-9f15-e02e7059ba8c tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:02.913260 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f2e86814-00c1-4cfa-9f15-e02e7059ba8c tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:02.917076 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6dabbaba-07ca-40f2-ae61-bfe15c3c75ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:02.917752 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6dabbaba-07ca-40f2-ae61-bfe15c3c75ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:02.918393 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6dabbaba-07ca-40f2-ae61-bfe15c3c75ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:02.918888 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6dabbaba-07ca-40f2-ae61-bfe15c3c75ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:03.117488 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f2e86814-00c1-4cfa-9f15-e02e7059ba8c tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:03.125583 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f2e86814-00c1-4cfa-9f15-e02e7059ba8c tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1314 microversion: 2.1 time: 0.226525 Dec 20 09:30:03.126279 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 174/302] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:02 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:03.126743 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6dabbaba-07ca-40f2-ae61-bfe15c3c75ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:03.135552 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6dabbaba-07ca-40f2-ae61-bfe15c3c75ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1318 microversion: 2.1 time: 0.232488 Dec 20 09:30:03.136357 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 129/303] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:02 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:03.564657 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-9ee33c1b-8065-4b66-8fa1-23d6784a7127 req-2f98c15d-d689-4ae2-97dc-b57925e8e951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65142080-4719-4e1f-935c-1da48a98445a", "tag": "e00c0b94-820e-49f9-967e-8ed64daa49ec"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:03.566597 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:30:03.566597 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:30:03.585099 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-301f978f-a72d-437a-a7dc-fdb27734fdc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:03.586022 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-301f978f-a72d-437a-a7dc-fdb27734fdc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:03.596275 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-301f978f-a72d-437a-a7dc-fdb27734fdc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:03.596716 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-301f978f-a72d-437a-a7dc-fdb27734fdc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:03.600109 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-9ee33c1b-8065-4b66-8fa1-23d6784a7127 req-2f98c15d-d689-4ae2-97dc-b57925e8e951 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:03.600241 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-301f978f-a72d-437a-a7dc-fdb27734fdc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:03.600545 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-9ee33c1b-8065-4b66-8fa1-23d6784a7127 req-2f98c15d-d689-4ae2-97dc-b57925e8e951 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:03.601120 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-301f978f-a72d-437a-a7dc-fdb27734fdc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:03.614357 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-9ee33c1b-8065-4b66-8fa1-23d6784a7127 req-2f98c15d-d689-4ae2-97dc-b57925e8e951 service nova] Creating event network-changed:e00c0b94-820e-49f9-967e-8ed64daa49ec for instance 65142080-4719-4e1f-935c-1da48a98445a on hv-cinder-81908 Dec 20 09:30:03.619766 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-9ee33c1b-8065-4b66-8fa1-23d6784a7127 req-2f98c15d-d689-4ae2-97dc-b57925e8e951 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059692 Dec 20 09:30:03.620748 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 175/304] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:30:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:30:03.625909 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5f33978c-8536-45b9-a9f6-a2d425fe36d5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:03.626599 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-5f33978c-8536-45b9-a9f6-a2d425fe36d5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:03.642545 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5f33978c-8536-45b9-a9f6-a2d425fe36d5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:03.642988 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5f33978c-8536-45b9-a9f6-a2d425fe36d5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:03.643800 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5f33978c-8536-45b9-a9f6-a2d425fe36d5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:03.644227 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5f33978c-8536-45b9-a9f6-a2d425fe36d5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:03.758098 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-301f978f-a72d-437a-a7dc-fdb27734fdc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.186752 Dec 20 09:30:03.758694 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 130/305] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:30:03 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:30:03.787042 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-5f33978c-8536-45b9-a9f6-a2d425fe36d5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:03.806644 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-5f33978c-8536-45b9-a9f6-a2d425fe36d5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.176787 Dec 20 09:30:03.806644 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 176/306] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:03 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:04.144224 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-468f34b8-de90-48d4-b4c0-88b9c087be1f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:04.144928 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-468f34b8-de90-48d4-b4c0-88b9c087be1f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:04.152312 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-468f34b8-de90-48d4-b4c0-88b9c087be1f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:04.152623 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-46549ff1-98c9-4414-8fe0-d3391c5b3fcd tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:04.153104 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-468f34b8-de90-48d4-b4c0-88b9c087be1f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:04.153529 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-468f34b8-de90-48d4-b4c0-88b9c087be1f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:04.153964 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-468f34b8-de90-48d4-b4c0-88b9c087be1f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:04.154315 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-46549ff1-98c9-4414-8fe0-d3391c5b3fcd tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:04.167208 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-46549ff1-98c9-4414-8fe0-d3391c5b3fcd tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:04.168164 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-46549ff1-98c9-4414-8fe0-d3391c5b3fcd tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:04.169250 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-46549ff1-98c9-4414-8fe0-d3391c5b3fcd tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:04.169872 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-46549ff1-98c9-4414-8fe0-d3391c5b3fcd tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:04.378328 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-468f34b8-de90-48d4-b4c0-88b9c087be1f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:04.383891 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-46549ff1-98c9-4414-8fe0-d3391c5b3fcd tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:04.386182 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-468f34b8-de90-48d4-b4c0-88b9c087be1f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1314 microversion: 2.1 time: 0.246128 Dec 20 09:30:04.386754 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 131/307] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:04 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:04.391318 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-46549ff1-98c9-4414-8fe0-d3391c5b3fcd tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1318 microversion: 2.1 time: 0.242770 Dec 20 09:30:04.391905 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 177/308] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:04 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:04.770289 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0eb5945d-5648-484f-8e9d-31835e6c8531 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:04.771511 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0eb5945d-5648-484f-8e9d-31835e6c8531 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:04.778617 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0eb5945d-5648-484f-8e9d-31835e6c8531 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:04.779197 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0eb5945d-5648-484f-8e9d-31835e6c8531 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:04.780135 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0eb5945d-5648-484f-8e9d-31835e6c8531 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:04.780638 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0eb5945d-5648-484f-8e9d-31835e6c8531 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:04.822045 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-27dd29ac-d1e9-4d93-abdc-2ded7baad121 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:04.822561 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-27dd29ac-d1e9-4d93-abdc-2ded7baad121 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:04.828779 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-27dd29ac-d1e9-4d93-abdc-2ded7baad121 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:04.829220 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-27dd29ac-d1e9-4d93-abdc-2ded7baad121 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:04.829998 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-27dd29ac-d1e9-4d93-abdc-2ded7baad121 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:04.830426 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-27dd29ac-d1e9-4d93-abdc-2ded7baad121 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:04.884132 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0eb5945d-5648-484f-8e9d-31835e6c8531 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.117142 Dec 20 09:30:04.885545 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 132/309] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:30:04 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:30:04.962903 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-27dd29ac-d1e9-4d93-abdc-2ded7baad121 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:04.970146 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-27dd29ac-d1e9-4d93-abdc-2ded7baad121 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.153064 Dec 20 09:30:04.970702 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 178/310] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:04 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:05.409054 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-5ccfd87f-0451-4ec9-8994-ab57e26e07a1 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:05.409788 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-5ccfd87f-0451-4ec9-8994-ab57e26e07a1 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:05.423260 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5ccfd87f-0451-4ec9-8994-ab57e26e07a1 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:05.423932 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5ccfd87f-0451-4ec9-8994-ab57e26e07a1 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:05.425385 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5ccfd87f-0451-4ec9-8994-ab57e26e07a1 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:05.425831 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5ccfd87f-0451-4ec9-8994-ab57e26e07a1 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:05.427070 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-41976656-06aa-46a8-91d2-d30312e894da tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:05.428123 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-41976656-06aa-46a8-91d2-d30312e894da tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:05.439304 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-41976656-06aa-46a8-91d2-d30312e894da tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:05.439826 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-41976656-06aa-46a8-91d2-d30312e894da tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:05.440652 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-41976656-06aa-46a8-91d2-d30312e894da tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:05.441089 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-41976656-06aa-46a8-91d2-d30312e894da tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:05.637174 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-5ccfd87f-0451-4ec9-8994-ab57e26e07a1 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:05.640959 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-41976656-06aa-46a8-91d2-d30312e894da tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:05.644977 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-5ccfd87f-0451-4ec9-8994-ab57e26e07a1 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1314 microversion: 2.1 time: 0.243448 Dec 20 09:30:05.645789 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 133/311] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:05 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:05.654712 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-41976656-06aa-46a8-91d2-d30312e894da tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1318 microversion: 2.1 time: 0.238468 Dec 20 09:30:05.656369 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 179/312] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:05 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:05.895999 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b27968ec-993e-4607-8af1-0166a770265a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:05.897091 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b27968ec-993e-4607-8af1-0166a770265a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:05.904111 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b27968ec-993e-4607-8af1-0166a770265a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:05.904561 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b27968ec-993e-4607-8af1-0166a770265a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:05.905426 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b27968ec-993e-4607-8af1-0166a770265a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:05.905863 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b27968ec-993e-4607-8af1-0166a770265a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:05.986608 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5d2d1eb9-c0c4-49c6-ab4e-f0f59a0646fb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:05.987216 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-5d2d1eb9-c0c4-49c6-ab4e-f0f59a0646fb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:05.993669 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5d2d1eb9-c0c4-49c6-ab4e-f0f59a0646fb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:05.994297 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5d2d1eb9-c0c4-49c6-ab4e-f0f59a0646fb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:05.995086 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5d2d1eb9-c0c4-49c6-ab4e-f0f59a0646fb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:05.995706 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5d2d1eb9-c0c4-49c6-ab4e-f0f59a0646fb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:06.037856 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b27968ec-993e-4607-8af1-0166a770265a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.145503 Dec 20 09:30:06.038717 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 134/313] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:30:05 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:30:06.139867 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-5d2d1eb9-c0c4-49c6-ab4e-f0f59a0646fb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:06.147869 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-5d2d1eb9-c0c4-49c6-ab4e-f0f59a0646fb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1522 microversion: 2.1 time: 0.164711 Dec 20 09:30:06.150643 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 180/314] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:05 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:06.662452 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ed4df9ac-c21c-45ca-81db-fe6b26c0dc5f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:06.663145 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ed4df9ac-c21c-45ca-81db-fe6b26c0dc5f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:06.671297 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ed4df9ac-c21c-45ca-81db-fe6b26c0dc5f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:06.671772 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ed4df9ac-c21c-45ca-81db-fe6b26c0dc5f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:06.672574 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ed4df9ac-c21c-45ca-81db-fe6b26c0dc5f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:06.673201 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7d17a6f1-114f-4134-95a0-d8ed063d0081 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:06.673682 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ed4df9ac-c21c-45ca-81db-fe6b26c0dc5f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:06.673967 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7d17a6f1-114f-4134-95a0-d8ed063d0081 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:06.680034 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7d17a6f1-114f-4134-95a0-d8ed063d0081 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:06.680546 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7d17a6f1-114f-4134-95a0-d8ed063d0081 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:06.682887 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7d17a6f1-114f-4134-95a0-d8ed063d0081 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:06.682887 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7d17a6f1-114f-4134-95a0-d8ed063d0081 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:06.913165 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7d17a6f1-114f-4134-95a0-d8ed063d0081 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:06.918000 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ed4df9ac-c21c-45ca-81db-fe6b26c0dc5f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:06.923110 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7d17a6f1-114f-4134-95a0-d8ed063d0081 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1318 microversion: 2.1 time: 0.254090 Dec 20 09:30:06.926869 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ed4df9ac-c21c-45ca-81db-fe6b26c0dc5f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1314 microversion: 2.1 time: 0.268324 Dec 20 09:30:06.927629 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 135/315] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:06 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:06.935173 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 181/316] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:06 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:07.050147 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c8208adb-d7c1-498d-abe5-255bdc52ca63 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:07.051053 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c8208adb-d7c1-498d-abe5-255bdc52ca63 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:07.057763 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c8208adb-d7c1-498d-abe5-255bdc52ca63 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:07.058207 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c8208adb-d7c1-498d-abe5-255bdc52ca63 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:07.058986 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c8208adb-d7c1-498d-abe5-255bdc52ca63 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:07.059417 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c8208adb-d7c1-498d-abe5-255bdc52ca63 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:07.173263 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c11f418c-75d8-4167-8999-e6e991af3390 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:07.173263 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c11f418c-75d8-4167-8999-e6e991af3390 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:07.177663 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c11f418c-75d8-4167-8999-e6e991af3390 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:07.178181 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c11f418c-75d8-4167-8999-e6e991af3390 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:07.179044 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c11f418c-75d8-4167-8999-e6e991af3390 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:07.179548 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c11f418c-75d8-4167-8999-e6e991af3390 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:07.256711 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c8208adb-d7c1-498d-abe5-255bdc52ca63 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.209733 Dec 20 09:30:07.258351 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 136/317] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:30:07 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:30:07.322313 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-c11f418c-75d8-4167-8999-e6e991af3390 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:07.330488 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c11f418c-75d8-4167-8999-e6e991af3390 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1502 microversion: 2.1 time: 0.163826 Dec 20 09:30:07.331158 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 182/318] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:07 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:07.351474 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-84840311-495c-4811-afa9-dadf5d69f7a2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:07.352369 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-84840311-495c-4811-afa9-dadf5d69f7a2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:07.361007 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-84840311-495c-4811-afa9-dadf5d69f7a2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:07.365424 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-84840311-495c-4811-afa9-dadf5d69f7a2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:07.365424 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-84840311-495c-4811-afa9-dadf5d69f7a2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:07.365424 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-84840311-495c-4811-afa9-dadf5d69f7a2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:07.504691 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-84840311-495c-4811-afa9-dadf5d69f7a2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:07.511954 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-84840311-495c-4811-afa9-dadf5d69f7a2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1515 microversion: 2.1 time: 0.164615 Dec 20 09:30:07.512526 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 137/319] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:07 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:07.941169 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-162ba37d-155d-4a19-a050-ae8e87263d63 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:07.941789 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-162ba37d-155d-4a19-a050-ae8e87263d63 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:07.945357 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a8510a54-aec4-43c2-affd-013c2fea270f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:07.946226 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a8510a54-aec4-43c2-affd-013c2fea270f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:07.951737 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-162ba37d-155d-4a19-a050-ae8e87263d63 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:07.952117 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-162ba37d-155d-4a19-a050-ae8e87263d63 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:07.952915 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-162ba37d-155d-4a19-a050-ae8e87263d63 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:07.953353 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-162ba37d-155d-4a19-a050-ae8e87263d63 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:07.953592 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a8510a54-aec4-43c2-affd-013c2fea270f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:07.954107 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a8510a54-aec4-43c2-affd-013c2fea270f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:07.956477 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a8510a54-aec4-43c2-affd-013c2fea270f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:07.956477 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a8510a54-aec4-43c2-affd-013c2fea270f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:08.233331 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-162ba37d-155d-4a19-a050-ae8e87263d63 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:08.252158 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-162ba37d-155d-4a19-a050-ae8e87263d63 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1318 microversion: 2.1 time: 0.308030 Dec 20 09:30:08.252158 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 183/320] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:07 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:08.257671 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a8510a54-aec4-43c2-affd-013c2fea270f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:08.284364 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a8510a54-aec4-43c2-affd-013c2fea270f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1314 microversion: 2.1 time: 0.341785 Dec 20 09:30:08.285543 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 138/321] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:07 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:08.304357 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-76fd0234-353b-4ddb-a84f-23a751d4cac0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:08.308364 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-76fd0234-353b-4ddb-a84f-23a751d4cac0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:08.316527 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-76fd0234-353b-4ddb-a84f-23a751d4cac0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:08.317130 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-76fd0234-353b-4ddb-a84f-23a751d4cac0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:08.318098 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-76fd0234-353b-4ddb-a84f-23a751d4cac0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:08.329377 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-76fd0234-353b-4ddb-a84f-23a751d4cac0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:08.551885 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-76fd0234-353b-4ddb-a84f-23a751d4cac0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.285455 Dec 20 09:30:08.554231 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 184/322] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:30:08 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:30:09.264907 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0ca90a32-8336-42bc-be09-8332256f32ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:09.266148 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0ca90a32-8336-42bc-be09-8332256f32ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:09.272699 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0ca90a32-8336-42bc-be09-8332256f32ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:09.273455 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0ca90a32-8336-42bc-be09-8332256f32ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:09.274378 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0ca90a32-8336-42bc-be09-8332256f32ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:09.274917 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0ca90a32-8336-42bc-be09-8332256f32ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:09.302917 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-51d9474e-f8e2-46f1-a8d3-f3e47dbe4ea9 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:09.303613 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-51d9474e-f8e2-46f1-a8d3-f3e47dbe4ea9 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:09.312116 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-51d9474e-f8e2-46f1-a8d3-f3e47dbe4ea9 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:09.312606 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-51d9474e-f8e2-46f1-a8d3-f3e47dbe4ea9 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:09.314021 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-51d9474e-f8e2-46f1-a8d3-f3e47dbe4ea9 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:09.314656 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-51d9474e-f8e2-46f1-a8d3-f3e47dbe4ea9 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:09.531920 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-0ca90a32-8336-42bc-be09-8332256f32ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:09.539340 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0ca90a32-8336-42bc-be09-8332256f32ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1318 microversion: 2.1 time: 0.278188 Dec 20 09:30:09.539942 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 139/323] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:09 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:09.564779 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-3f89ccbb-dac7-41de-88fd-a49ebf16223f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:09.566581 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-3f89ccbb-dac7-41de-88fd-a49ebf16223f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:09.575507 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3f89ccbb-dac7-41de-88fd-a49ebf16223f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:09.576340 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3f89ccbb-dac7-41de-88fd-a49ebf16223f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:09.576601 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-51d9474e-f8e2-46f1-a8d3-f3e47dbe4ea9 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:09.577598 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3f89ccbb-dac7-41de-88fd-a49ebf16223f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:09.578393 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3f89ccbb-dac7-41de-88fd-a49ebf16223f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:09.584115 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-51d9474e-f8e2-46f1-a8d3-f3e47dbe4ea9 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1314 microversion: 2.1 time: 0.285411 Dec 20 09:30:09.584686 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 185/324] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:09 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:10.557103 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-580a7aa0-984f-4b8d-9100-acf413f4bbe5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:10.557702 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-580a7aa0-984f-4b8d-9100-acf413f4bbe5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:10.565664 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-580a7aa0-984f-4b8d-9100-acf413f4bbe5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:10.567486 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-580a7aa0-984f-4b8d-9100-acf413f4bbe5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:10.568373 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-580a7aa0-984f-4b8d-9100-acf413f4bbe5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:10.568906 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-580a7aa0-984f-4b8d-9100-acf413f4bbe5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:10.759387 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-580a7aa0-984f-4b8d-9100-acf413f4bbe5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:10.767401 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-580a7aa0-984f-4b8d-9100-acf413f4bbe5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1318 microversion: 2.1 time: 0.213901 Dec 20 09:30:10.768000 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 186/325] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:10 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:10.772295 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5d5cd201-d650-41fc-be7f-f50029942dbd tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:10.772889 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-5d5cd201-d650-41fc-be7f-f50029942dbd tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:10.778460 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5d5cd201-d650-41fc-be7f-f50029942dbd tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:10.778904 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5d5cd201-d650-41fc-be7f-f50029942dbd tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:10.779699 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5d5cd201-d650-41fc-be7f-f50029942dbd tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:10.780138 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5d5cd201-d650-41fc-be7f-f50029942dbd tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:11.000932 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-5d5cd201-d650-41fc-be7f-f50029942dbd tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:11.009248 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-5d5cd201-d650-41fc-be7f-f50029942dbd tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1314 microversion: 2.1 time: 0.240247 Dec 20 09:30:11.009863 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 187/326] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:10 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:11.058889 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-020ea936-256d-424a-b7a0-7c30749e0743 req-55b8f751-baf7-4fc5-a64a-b907659e8cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f2bd5eb-b318-41f6-a143-65f3f05bd1d8", "name": "network-vif-plugged", "status": "completed", "tag": "6899c157-c762-49a5-ae5b-ee0327084337"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:11.060810 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:30:11.060810 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:30:11.068082 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-020ea936-256d-424a-b7a0-7c30749e0743 req-55b8f751-baf7-4fc5-a64a-b907659e8cb0 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:11.068613 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-020ea936-256d-424a-b7a0-7c30749e0743 req-55b8f751-baf7-4fc5-a64a-b907659e8cb0 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:11.079739 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-020ea936-256d-424a-b7a0-7c30749e0743 req-55b8f751-baf7-4fc5-a64a-b907659e8cb0 service nova] Creating event network-vif-plugged:6899c157-c762-49a5-ae5b-ee0327084337 for instance 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 on hv-cinder-81908 Dec 20 09:30:11.084623 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-020ea936-256d-424a-b7a0-7c30749e0743 req-55b8f751-baf7-4fc5-a64a-b907659e8cb0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030106 Dec 20 09:30:11.085480 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 188/327] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:30:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:30:11.785801 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e209accc-4cf3-407d-9697-4b0760a3385c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:11.786569 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e209accc-4cf3-407d-9697-4b0760a3385c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:11.797135 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e209accc-4cf3-407d-9697-4b0760a3385c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:11.797705 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e209accc-4cf3-407d-9697-4b0760a3385c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:11.798573 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e209accc-4cf3-407d-9697-4b0760a3385c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:11.799013 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e209accc-4cf3-407d-9697-4b0760a3385c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:11.948562 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e209accc-4cf3-407d-9697-4b0760a3385c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:11.956024 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e209accc-4cf3-407d-9697-4b0760a3385c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1318 microversion: 2.1 time: 0.175455 Dec 20 09:30:11.956898 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 189/328] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:11 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:12.026439 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-94086395-0f67-4784-819a-4d06ab600043 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:12.027281 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-94086395-0f67-4784-819a-4d06ab600043 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:12.033824 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-94086395-0f67-4784-819a-4d06ab600043 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:12.034233 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-94086395-0f67-4784-819a-4d06ab600043 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:12.035096 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-94086395-0f67-4784-819a-4d06ab600043 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:12.035611 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-94086395-0f67-4784-819a-4d06ab600043 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:12.181894 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-94086395-0f67-4784-819a-4d06ab600043 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:12.190140 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-94086395-0f67-4784-819a-4d06ab600043 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1314 microversion: 2.1 time: 0.167986 Dec 20 09:30:12.191792 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 190/329] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:12 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:12.683863 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-3f89ccbb-dac7-41de-88fd-a49ebf16223f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 3.122623 Dec 20 09:30:12.684511 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 140/330] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:30:09 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 3124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:30:12.973711 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e06453fd-429e-4568-9427-c50c7443cbe2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:12.974391 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e06453fd-429e-4568-9427-c50c7443cbe2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:12.992091 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e06453fd-429e-4568-9427-c50c7443cbe2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:12.992091 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e06453fd-429e-4568-9427-c50c7443cbe2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:12.992091 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e06453fd-429e-4568-9427-c50c7443cbe2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:12.992091 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e06453fd-429e-4568-9427-c50c7443cbe2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:13.197955 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e06453fd-429e-4568-9427-c50c7443cbe2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:13.206789 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e06453fd-429e-4568-9427-c50c7443cbe2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1318 microversion: 2.1 time: 0.237048 Dec 20 09:30:13.207363 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 191/331] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:12 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:13.208462 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a2e7dc08-0595-4ad9-b29c-6479b5bab4b2 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:13.209356 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a2e7dc08-0595-4ad9-b29c-6479b5bab4b2 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:13.216279 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a2e7dc08-0595-4ad9-b29c-6479b5bab4b2 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:13.216750 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a2e7dc08-0595-4ad9-b29c-6479b5bab4b2 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:13.217526 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a2e7dc08-0595-4ad9-b29c-6479b5bab4b2 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:13.217989 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a2e7dc08-0595-4ad9-b29c-6479b5bab4b2 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:13.352431 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a2e7dc08-0595-4ad9-b29c-6479b5bab4b2 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:13.360156 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a2e7dc08-0595-4ad9-b29c-6479b5bab4b2 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1314 microversion: 2.1 time: 0.156338 Dec 20 09:30:13.360720 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 141/332] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:13 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:13.695179 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-17eed3a8-af6c-4226-9a61-7e7245c95a4c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:13.696114 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-17eed3a8-af6c-4226-9a61-7e7245c95a4c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:13.702622 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-17eed3a8-af6c-4226-9a61-7e7245c95a4c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:13.703065 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-17eed3a8-af6c-4226-9a61-7e7245c95a4c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:13.704079 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-17eed3a8-af6c-4226-9a61-7e7245c95a4c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:13.704507 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-17eed3a8-af6c-4226-9a61-7e7245c95a4c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:13.802896 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-17eed3a8-af6c-4226-9a61-7e7245c95a4c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.111483 Dec 20 09:30:13.803547 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 192/333] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:30:13 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:30:13.866789 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9ad65379-fb9d-4fe6-8204-00aec0f7d676 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:13.868549 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9ad65379-fb9d-4fe6-8204-00aec0f7d676 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:13.876949 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9ad65379-fb9d-4fe6-8204-00aec0f7d676 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:13.881025 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9ad65379-fb9d-4fe6-8204-00aec0f7d676 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:13.881025 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9ad65379-fb9d-4fe6-8204-00aec0f7d676 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:13.881025 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9ad65379-fb9d-4fe6-8204-00aec0f7d676 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:13.911518 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.objects.instance [None req-9ad65379-fb9d-4fe6-8204-00aec0f7d676 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lazy-loading 'flavor' on Instance uuid 1af8e934-5860-485f-abf5-42a2814d66e7 {{(pid=116675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:30:14.224357 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-13f7380e-aa22-4639-900c-7db9a29c5f05 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:14.224885 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9ad65379-fb9d-4fe6-8204-00aec0f7d676 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "POST /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7/action" status: 200 len: 32 microversion: 2.1 time: 0.361634 Dec 20 09:30:14.225147 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 142/334] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:30:13 2021] POST /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7/action => generated 32 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 20 09:30:14.225295 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-13f7380e-aa22-4639-900c-7db9a29c5f05 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:14.233374 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-13f7380e-aa22-4639-900c-7db9a29c5f05 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:14.233820 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-13f7380e-aa22-4639-900c-7db9a29c5f05 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:14.234709 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-13f7380e-aa22-4639-900c-7db9a29c5f05 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:14.235191 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-13f7380e-aa22-4639-900c-7db9a29c5f05 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:14.235567 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b4dbe19e-5fcd-42a7-b665-a3a976de2ccb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:14.236413 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b4dbe19e-5fcd-42a7-b665-a3a976de2ccb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:14.242755 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b4dbe19e-5fcd-42a7-b665-a3a976de2ccb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:14.243354 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b4dbe19e-5fcd-42a7-b665-a3a976de2ccb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:14.244823 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b4dbe19e-5fcd-42a7-b665-a3a976de2ccb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:14.245363 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b4dbe19e-5fcd-42a7-b665-a3a976de2ccb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:14.451695 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-13f7380e-aa22-4639-900c-7db9a29c5f05 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:14.456203 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b4dbe19e-5fcd-42a7-b665-a3a976de2ccb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:14.466598 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-13f7380e-aa22-4639-900c-7db9a29c5f05 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1318 microversion: 2.1 time: 0.246922 Dec 20 09:30:14.467491 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 193/335] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:14 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:14.484165 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3f506c0e-04fa-4acb-99bb-1b3369874337 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:14.484530 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b4dbe19e-5fcd-42a7-b665-a3a976de2ccb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.253104 Dec 20 09:30:14.495308 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 143/336] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:14 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:14.495397 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-3f506c0e-04fa-4acb-99bb-1b3369874337 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:14.507042 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3f506c0e-04fa-4acb-99bb-1b3369874337 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:14.507860 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3f506c0e-04fa-4acb-99bb-1b3369874337 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:14.508958 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3f506c0e-04fa-4acb-99bb-1b3369874337 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:14.509651 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3f506c0e-04fa-4acb-99bb-1b3369874337 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:14.669246 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3f506c0e-04fa-4acb-99bb-1b3369874337 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:14.678148 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3f506c0e-04fa-4acb-99bb-1b3369874337 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1314 microversion: 2.1 time: 0.204104 Dec 20 09:30:14.678717 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 194/337] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:14 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:14.814716 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6ac6731c-614d-4926-a1de-28dd60317287 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:14.815644 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6ac6731c-614d-4926-a1de-28dd60317287 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:14.832084 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6ac6731c-614d-4926-a1de-28dd60317287 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:14.832532 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6ac6731c-614d-4926-a1de-28dd60317287 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:14.833383 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6ac6731c-614d-4926-a1de-28dd60317287 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:14.833978 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6ac6731c-614d-4926-a1de-28dd60317287 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:14.948886 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6ac6731c-614d-4926-a1de-28dd60317287 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.137951 Dec 20 09:30:14.949890 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 144/338] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:30:14 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:30:14.995415 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-887d2c9d-8db5-463b-b2a9-de53e498da67 req-927e066a-394d-4471-b7ee-e84dbe0de356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65142080-4719-4e1f-935c-1da48a98445a", "name": "network-vif-plugged", "status": "completed", "tag": "e00c0b94-820e-49f9-967e-8ed64daa49ec"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:14.997034 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:30:14.997034 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:30:15.004354 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-887d2c9d-8db5-463b-b2a9-de53e498da67 req-927e066a-394d-4471-b7ee-e84dbe0de356 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:15.004800 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-887d2c9d-8db5-463b-b2a9-de53e498da67 req-927e066a-394d-4471-b7ee-e84dbe0de356 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:15.016779 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-887d2c9d-8db5-463b-b2a9-de53e498da67 req-927e066a-394d-4471-b7ee-e84dbe0de356 service nova] Creating event network-vif-plugged:e00c0b94-820e-49f9-967e-8ed64daa49ec for instance 65142080-4719-4e1f-935c-1da48a98445a on hv-cinder-81908 Dec 20 09:30:15.022328 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-887d2c9d-8db5-463b-b2a9-de53e498da67 req-927e066a-394d-4471-b7ee-e84dbe0de356 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037479 Dec 20 09:30:15.022328 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 195/339] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:30:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:30:15.486488 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-acab2bd4-4a8c-4bfd-b5f5-170373a2ab50 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:15.487315 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-acab2bd4-4a8c-4bfd-b5f5-170373a2ab50 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:15.495289 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-acab2bd4-4a8c-4bfd-b5f5-170373a2ab50 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:15.497646 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-acab2bd4-4a8c-4bfd-b5f5-170373a2ab50 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:15.498530 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-acab2bd4-4a8c-4bfd-b5f5-170373a2ab50 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:15.499194 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-acab2bd4-4a8c-4bfd-b5f5-170373a2ab50 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:15.508419 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5624c170-d30c-4266-916a-3fd8d54b8972 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:15.517084 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-5624c170-d30c-4266-916a-3fd8d54b8972 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:15.533032 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5624c170-d30c-4266-916a-3fd8d54b8972 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:15.535494 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5624c170-d30c-4266-916a-3fd8d54b8972 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:15.535494 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5624c170-d30c-4266-916a-3fd8d54b8972 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:15.535494 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5624c170-d30c-4266-916a-3fd8d54b8972 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:15.709609 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-acab2bd4-4a8c-4bfd-b5f5-170373a2ab50 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:15.717496 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-acab2bd4-4a8c-4bfd-b5f5-170373a2ab50 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1509 microversion: 2.1 time: 0.236519 Dec 20 09:30:15.718173 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 145/340] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:15 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1509 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:15.722640 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-80a2ca64-ddb7-416c-ac4d-e129eb6b5a01 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:15.723887 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-80a2ca64-ddb7-416c-ac4d-e129eb6b5a01 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:15.731853 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-80a2ca64-ddb7-416c-ac4d-e129eb6b5a01 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:15.732552 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-80a2ca64-ddb7-416c-ac4d-e129eb6b5a01 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:15.733703 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-80a2ca64-ddb7-416c-ac4d-e129eb6b5a01 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:15.734149 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-80a2ca64-ddb7-416c-ac4d-e129eb6b5a01 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:15.736768 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-5624c170-d30c-4266-916a-3fd8d54b8972 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:15.746329 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-5624c170-d30c-4266-916a-3fd8d54b8972 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.246996 Dec 20 09:30:15.747140 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 196/341] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:15 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:15.874050 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-80a2ca64-ddb7-416c-ac4d-e129eb6b5a01 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:15.881728 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-80a2ca64-ddb7-416c-ac4d-e129eb6b5a01 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1314 microversion: 2.1 time: 0.162560 Dec 20 09:30:15.882297 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 146/342] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:15 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:15.966567 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-fdbf9e37-bf16-4680-bf61-8b45eae47b4a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:15.967759 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-fdbf9e37-bf16-4680-bf61-8b45eae47b4a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:15.975441 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fdbf9e37-bf16-4680-bf61-8b45eae47b4a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:15.975918 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fdbf9e37-bf16-4680-bf61-8b45eae47b4a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:15.976710 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fdbf9e37-bf16-4680-bf61-8b45eae47b4a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:15.977147 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fdbf9e37-bf16-4680-bf61-8b45eae47b4a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:16.057934 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-fdbf9e37-bf16-4680-bf61-8b45eae47b4a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.096471 Dec 20 09:30:16.058635 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 197/343] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:30:15 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:30:16.764217 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-92a6c1a7-9360-4e45-8f6b-216be4c43a3e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:16.764872 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-92a6c1a7-9360-4e45-8f6b-216be4c43a3e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:16.771071 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-92a6c1a7-9360-4e45-8f6b-216be4c43a3e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:16.771511 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-92a6c1a7-9360-4e45-8f6b-216be4c43a3e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:16.772392 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-92a6c1a7-9360-4e45-8f6b-216be4c43a3e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:16.772821 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-92a6c1a7-9360-4e45-8f6b-216be4c43a3e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:16.899351 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b9cb8d77-2bb7-454c-8407-b80799875b24 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:16.900255 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b9cb8d77-2bb7-454c-8407-b80799875b24 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:16.959683 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-92a6c1a7-9360-4e45-8f6b-216be4c43a3e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:16.959920 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b9cb8d77-2bb7-454c-8407-b80799875b24 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:16.959920 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b9cb8d77-2bb7-454c-8407-b80799875b24 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:16.959920 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b9cb8d77-2bb7-454c-8407-b80799875b24 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:16.959920 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b9cb8d77-2bb7-454c-8407-b80799875b24 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:16.960487 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-92a6c1a7-9360-4e45-8f6b-216be4c43a3e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.157353 Dec 20 09:30:16.960487 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 147/344] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:16 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:17.050422 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b9cb8d77-2bb7-454c-8407-b80799875b24 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:17.061812 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b9cb8d77-2bb7-454c-8407-b80799875b24 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1314 microversion: 2.1 time: 0.167052 Dec 20 09:30:17.066032 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 198/345] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:16 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:17.071409 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0a7f5e16-7216-4a0f-bb80-63bcc6bc437e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:17.077650 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0a7f5e16-7216-4a0f-bb80-63bcc6bc437e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:17.083878 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0a7f5e16-7216-4a0f-bb80-63bcc6bc437e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:17.084330 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0a7f5e16-7216-4a0f-bb80-63bcc6bc437e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:17.085150 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0a7f5e16-7216-4a0f-bb80-63bcc6bc437e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:17.085589 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0a7f5e16-7216-4a0f-bb80-63bcc6bc437e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:17.244832 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0a7f5e16-7216-4a0f-bb80-63bcc6bc437e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.177814 Dec 20 09:30:17.248742 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 148/346] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:30:17 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:30:17.934505 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-988537e7-3a3b-4ea3-a61f-4e894be58ba9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:17.936551 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-988537e7-3a3b-4ea3-a61f-4e894be58ba9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:17.943236 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-988537e7-3a3b-4ea3-a61f-4e894be58ba9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:17.947490 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-988537e7-3a3b-4ea3-a61f-4e894be58ba9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:17.947490 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-988537e7-3a3b-4ea3-a61f-4e894be58ba9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:17.947490 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-988537e7-3a3b-4ea3-a61f-4e894be58ba9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:18.077076 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-988537e7-3a3b-4ea3-a61f-4e894be58ba9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:18.081699 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-264e17ba-f910-40ab-8e75-ef586ca14044 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:18.082424 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-264e17ba-f910-40ab-8e75-ef586ca14044 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:18.090303 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-264e17ba-f910-40ab-8e75-ef586ca14044 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:18.090742 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-264e17ba-f910-40ab-8e75-ef586ca14044 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:18.091421 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-988537e7-3a3b-4ea3-a61f-4e894be58ba9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.161823 Dec 20 09:30:18.091711 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-264e17ba-f910-40ab-8e75-ef586ca14044 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:18.092035 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 199/347] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:17 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:18.098661 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-264e17ba-f910-40ab-8e75-ef586ca14044 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:18.224344 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-264e17ba-f910-40ab-8e75-ef586ca14044 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:18.231488 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-264e17ba-f910-40ab-8e75-ef586ca14044 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1498 microversion: 2.1 time: 0.154114 Dec 20 09:30:18.232072 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 149/348] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:18 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:18.258300 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c0418423-eefc-481f-a670-5756032336e4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:18.260152 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c0418423-eefc-481f-a670-5756032336e4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:18.266592 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c0418423-eefc-481f-a670-5756032336e4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:18.267030 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c0418423-eefc-481f-a670-5756032336e4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:18.267840 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c0418423-eefc-481f-a670-5756032336e4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:18.268273 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c0418423-eefc-481f-a670-5756032336e4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:18.615399 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c0418423-eefc-481f-a670-5756032336e4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.360536 Dec 20 09:30:18.616087 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 200/349] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:30:18 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:30:18.699148 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-16a1784d-ef46-444e-be8f-b13e978ca1ba tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e65e575-ec37-4e40-a4e4-e6c97b70479c"}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:18.700311 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-16a1784d-ef46-444e-be8f-b13e978ca1ba tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:18.706653 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-16a1784d-ef46-444e-be8f-b13e978ca1ba tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:18.710010 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-16a1784d-ef46-444e-be8f-b13e978ca1ba tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:18.710010 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-16a1784d-ef46-444e-be8f-b13e978ca1ba tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:18.710010 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-16a1784d-ef46-444e-be8f-b13e978ca1ba tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:19.108352 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b16ab74f-ac4e-4c88-a57d-397648f9151f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:19.109055 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b16ab74f-ac4e-4c88-a57d-397648f9151f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:19.116824 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b16ab74f-ac4e-4c88-a57d-397648f9151f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:19.117494 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b16ab74f-ac4e-4c88-a57d-397648f9151f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:19.118282 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b16ab74f-ac4e-4c88-a57d-397648f9151f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:19.118721 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b16ab74f-ac4e-4c88-a57d-397648f9151f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:19.249343 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b16ab74f-ac4e-4c88-a57d-397648f9151f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:19.257345 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b16ab74f-ac4e-4c88-a57d-397648f9151f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.153024 Dec 20 09:30:19.257918 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 201/350] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:19 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:19.628846 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-fe458f7a-bacb-4a16-bbab-6538dbc48889 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:19.629685 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-fe458f7a-bacb-4a16-bbab-6538dbc48889 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:19.635995 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fe458f7a-bacb-4a16-bbab-6538dbc48889 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:19.636442 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fe458f7a-bacb-4a16-bbab-6538dbc48889 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:19.637221 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fe458f7a-bacb-4a16-bbab-6538dbc48889 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:19.637657 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fe458f7a-bacb-4a16-bbab-6538dbc48889 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:23.350374 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-fe458f7a-bacb-4a16-bbab-6538dbc48889 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 3.726091 Dec 20 09:30:23.351891 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 202/351] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:30:19 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 3729 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:30:23.361913 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-dbe3f572-8c23-4115-a631-d6b90a13b426 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:23.362725 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-dbe3f572-8c23-4115-a631-d6b90a13b426 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:23.370223 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dbe3f572-8c23-4115-a631-d6b90a13b426 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:23.370675 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dbe3f572-8c23-4115-a631-d6b90a13b426 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:23.371841 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dbe3f572-8c23-4115-a631-d6b90a13b426 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:23.372290 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dbe3f572-8c23-4115-a631-d6b90a13b426 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:23.537770 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-dbe3f572-8c23-4115-a631-d6b90a13b426 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:23.548615 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-dbe3f572-8c23-4115-a631-d6b90a13b426 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.195252 Dec 20 09:30:23.549889 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 203/352] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:23 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:24.041854 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-16a1784d-ef46-444e-be8f-b13e978ca1ba tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "POST /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.346786 Dec 20 09:30:24.042472 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 150/353] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 20 09:30:18 2021] POST /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8/os-volume_attachments => generated 194 bytes in 5348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:30:24.193809 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-6a321768-8a90-4afe-87b2-a9a400b20a81 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:24.194310 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-6a321768-8a90-4afe-87b2-a9a400b20a81 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:24.201571 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6a321768-8a90-4afe-87b2-a9a400b20a81 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:24.202095 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6a321768-8a90-4afe-87b2-a9a400b20a81 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:24.202954 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6a321768-8a90-4afe-87b2-a9a400b20a81 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:24.203495 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6a321768-8a90-4afe-87b2-a9a400b20a81 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:24.235973 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-6a321768-8a90-4afe-87b2-a9a400b20a81 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Going to try to terminate instance {{(pid=116674) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 09:30:24.364127 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ecfd42b9-3d2b-49e0-9db0-759b044e2ef6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:24.365136 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ecfd42b9-3d2b-49e0-9db0-759b044e2ef6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:24.372313 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ecfd42b9-3d2b-49e0-9db0-759b044e2ef6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:24.372807 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ecfd42b9-3d2b-49e0-9db0-759b044e2ef6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:24.373589 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ecfd42b9-3d2b-49e0-9db0-759b044e2ef6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:24.374032 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ecfd42b9-3d2b-49e0-9db0-759b044e2ef6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:24.465053 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ecfd42b9-3d2b-49e0-9db0-759b044e2ef6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.104841 Dec 20 09:30:24.465743 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 151/354] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:30:24 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:30:24.514608 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-6a321768-8a90-4afe-87b2-a9a400b20a81 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "DELETE /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 204 len: 0 microversion: 2.1 time: 0.324282 Dec 20 09:30:24.515244 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 204/355] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 20 09:30:24 2021] DELETE /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 09:30:24.523534 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-02ac11e4-356b-4df9-896d-d16f465a72ea tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:24.524286 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-02ac11e4-356b-4df9-896d-d16f465a72ea tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:24.531680 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-02ac11e4-356b-4df9-896d-d16f465a72ea tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:24.532172 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-02ac11e4-356b-4df9-896d-d16f465a72ea tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:24.532958 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-02ac11e4-356b-4df9-896d-d16f465a72ea tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:24.533397 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-02ac11e4-356b-4df9-896d-d16f465a72ea tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:24.568124 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5b20b8a1-1fb8-4a68-8597-8f62f5c104aa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:24.569064 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-5b20b8a1-1fb8-4a68-8597-8f62f5c104aa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:24.576631 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5b20b8a1-1fb8-4a68-8597-8f62f5c104aa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:24.577174 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5b20b8a1-1fb8-4a68-8597-8f62f5c104aa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:24.578361 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5b20b8a1-1fb8-4a68-8597-8f62f5c104aa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:24.578944 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5b20b8a1-1fb8-4a68-8597-8f62f5c104aa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:24.722106 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-02ac11e4-356b-4df9-896d-d16f465a72ea tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:24.730997 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-02ac11e4-356b-4df9-896d-d16f465a72ea tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1504 microversion: 2.1 time: 0.211453 Dec 20 09:30:24.733172 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 152/356] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:24 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1504 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:24.757559 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-5b20b8a1-1fb8-4a68-8597-8f62f5c104aa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:24.766020 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-5b20b8a1-1fb8-4a68-8597-8f62f5c104aa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.202602 Dec 20 09:30:24.766594 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 205/357] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:24 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:25.477099 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-85f11ce7-71d3-4156-a76d-0e95bf28ed12 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:25.478013 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-85f11ce7-71d3-4156-a76d-0e95bf28ed12 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:25.484361 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-85f11ce7-71d3-4156-a76d-0e95bf28ed12 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:25.484801 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-85f11ce7-71d3-4156-a76d-0e95bf28ed12 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:25.485624 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-85f11ce7-71d3-4156-a76d-0e95bf28ed12 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:25.486051 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-85f11ce7-71d3-4156-a76d-0e95bf28ed12 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:25.586191 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-85f11ce7-71d3-4156-a76d-0e95bf28ed12 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.112942 Dec 20 09:30:25.586999 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 153/358] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:30:25 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:30:25.748507 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7b5ecc18-420f-49f8-8c84-e09f4d8dd62f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:25.749122 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7b5ecc18-420f-49f8-8c84-e09f4d8dd62f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:25.755560 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7b5ecc18-420f-49f8-8c84-e09f4d8dd62f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:25.756047 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7b5ecc18-420f-49f8-8c84-e09f4d8dd62f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:25.756816 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7b5ecc18-420f-49f8-8c84-e09f4d8dd62f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:25.757254 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7b5ecc18-420f-49f8-8c84-e09f4d8dd62f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:25.782451 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f95310a9-7ccb-4b20-8eee-81e285404fe7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:25.783155 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f95310a9-7ccb-4b20-8eee-81e285404fe7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:25.789968 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f95310a9-7ccb-4b20-8eee-81e285404fe7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:25.790419 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f95310a9-7ccb-4b20-8eee-81e285404fe7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:25.791406 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f95310a9-7ccb-4b20-8eee-81e285404fe7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:25.791879 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f95310a9-7ccb-4b20-8eee-81e285404fe7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:25.946491 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7b5ecc18-420f-49f8-8c84-e09f4d8dd62f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:25.964986 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7b5ecc18-420f-49f8-8c84-e09f4d8dd62f tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1504 microversion: 2.1 time: 0.219480 Dec 20 09:30:25.976957 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 206/359] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:25 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:25.996799 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f95310a9-7ccb-4b20-8eee-81e285404fe7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:26.004219 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f95310a9-7ccb-4b20-8eee-81e285404fe7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.225615 Dec 20 09:30:26.004790 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 154/360] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:25 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:26.640176 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-01c228b2-ba26-4f7a-be27-1e35aa93ac1c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:26.641124 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-01c228b2-ba26-4f7a-be27-1e35aa93ac1c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:26.646865 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-01c228b2-ba26-4f7a-be27-1e35aa93ac1c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:26.651303 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-01c228b2-ba26-4f7a-be27-1e35aa93ac1c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:26.651303 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-01c228b2-ba26-4f7a-be27-1e35aa93ac1c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:26.651303 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-01c228b2-ba26-4f7a-be27-1e35aa93ac1c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:26.984447 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e80e7829-a67e-4a40-a4d1-61d7fb1e5f41 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:26.985079 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e80e7829-a67e-4a40-a4d1-61d7fb1e5f41 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:26.991303 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e80e7829-a67e-4a40-a4d1-61d7fb1e5f41 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:26.991787 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e80e7829-a67e-4a40-a4d1-61d7fb1e5f41 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:26.992578 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e80e7829-a67e-4a40-a4d1-61d7fb1e5f41 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:26.992995 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e80e7829-a67e-4a40-a4d1-61d7fb1e5f41 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:27.124509 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e80e7829-a67e-4a40-a4d1-61d7fb1e5f41 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:27.133367 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e80e7829-a67e-4a40-a4d1-61d7fb1e5f41 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1504 microversion: 2.1 time: 0.152571 Dec 20 09:30:27.133943 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 155/361] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:26 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:27.138797 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-dc71969d-6841-4283-a1cd-fb8ad277f877 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:27.146354 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-dc71969d-6841-4283-a1cd-fb8ad277f877 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:27.146354 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-dc71969d-6841-4283-a1cd-fb8ad277f877 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:27.146354 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-dc71969d-6841-4283-a1cd-fb8ad277f877 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:27.146354 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-dc71969d-6841-4283-a1cd-fb8ad277f877 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:27.146728 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-dc71969d-6841-4283-a1cd-fb8ad277f877 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:27.277267 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-dc71969d-6841-4283-a1cd-fb8ad277f877 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:27.284477 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-dc71969d-6841-4283-a1cd-fb8ad277f877 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.149599 Dec 20 09:30:27.285096 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 156/362] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:27 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:28.151793 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-39041c81-78e2-481c-82c5-90180780b134 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:28.152417 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-39041c81-78e2-481c-82c5-90180780b134 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:28.158489 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-39041c81-78e2-481c-82c5-90180780b134 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:28.158927 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-39041c81-78e2-481c-82c5-90180780b134 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:28.159720 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-39041c81-78e2-481c-82c5-90180780b134 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:28.160150 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-39041c81-78e2-481c-82c5-90180780b134 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:28.289923 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-39041c81-78e2-481c-82c5-90180780b134 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:28.298087 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-39041c81-78e2-481c-82c5-90180780b134 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1504 microversion: 2.1 time: 0.151034 Dec 20 09:30:28.298651 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 157/363] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:28 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:28.302938 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-771a3b1e-ae15-4ca5-8857-7c0f0b627869 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:28.303510 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-771a3b1e-ae15-4ca5-8857-7c0f0b627869 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:28.310287 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-771a3b1e-ae15-4ca5-8857-7c0f0b627869 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:28.310724 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-771a3b1e-ae15-4ca5-8857-7c0f0b627869 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:28.311512 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-771a3b1e-ae15-4ca5-8857-7c0f0b627869 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:28.311975 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-771a3b1e-ae15-4ca5-8857-7c0f0b627869 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:28.466608 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-771a3b1e-ae15-4ca5-8857-7c0f0b627869 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:28.474347 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-771a3b1e-ae15-4ca5-8857-7c0f0b627869 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.174732 Dec 20 09:30:28.474917 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 158/364] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:28 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:29.316176 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-43c3b0bd-fbf0-4a9b-bf61-79195842743a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:29.316864 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-43c3b0bd-fbf0-4a9b-bf61-79195842743a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:29.323398 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-43c3b0bd-fbf0-4a9b-bf61-79195842743a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:29.323880 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-43c3b0bd-fbf0-4a9b-bf61-79195842743a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:29.324656 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-43c3b0bd-fbf0-4a9b-bf61-79195842743a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:29.325094 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-43c3b0bd-fbf0-4a9b-bf61-79195842743a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:29.457650 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-43c3b0bd-fbf0-4a9b-bf61-79195842743a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:29.465047 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-43c3b0bd-fbf0-4a9b-bf61-79195842743a tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1504 microversion: 2.1 time: 0.152664 Dec 20 09:30:29.465625 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 159/365] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:29 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:29.491346 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ed619068-2b20-4393-be88-42b24385ad68 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:29.492167 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ed619068-2b20-4393-be88-42b24385ad68 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:29.498849 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ed619068-2b20-4393-be88-42b24385ad68 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:29.499216 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ed619068-2b20-4393-be88-42b24385ad68 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:29.499991 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ed619068-2b20-4393-be88-42b24385ad68 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:29.500432 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ed619068-2b20-4393-be88-42b24385ad68 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:29.625777 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ed619068-2b20-4393-be88-42b24385ad68 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:29.633333 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ed619068-2b20-4393-be88-42b24385ad68 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.145628 Dec 20 09:30:29.633888 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 160/366] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:29 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:30.484605 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-eba7ba9e-ee16-492a-8a7f-07b18d94e6d1 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:30.485313 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-eba7ba9e-ee16-492a-8a7f-07b18d94e6d1 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:30.491390 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eba7ba9e-ee16-492a-8a7f-07b18d94e6d1 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:30.491876 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eba7ba9e-ee16-492a-8a7f-07b18d94e6d1 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:30.492658 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eba7ba9e-ee16-492a-8a7f-07b18d94e6d1 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:30.493094 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eba7ba9e-ee16-492a-8a7f-07b18d94e6d1 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:30.628275 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-eba7ba9e-ee16-492a-8a7f-07b18d94e6d1 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:30.642482 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-eba7ba9e-ee16-492a-8a7f-07b18d94e6d1 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1504 microversion: 2.1 time: 0.158853 Dec 20 09:30:30.642482 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 161/367] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:30 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:30.649750 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-58b8cc61-0a52-4277-9c9f-cdad4ce41804 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:30.653075 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-58b8cc61-0a52-4277-9c9f-cdad4ce41804 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:30.658144 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-58b8cc61-0a52-4277-9c9f-cdad4ce41804 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:30.658588 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-58b8cc61-0a52-4277-9c9f-cdad4ce41804 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:30.659364 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-58b8cc61-0a52-4277-9c9f-cdad4ce41804 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:30.659823 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-58b8cc61-0a52-4277-9c9f-cdad4ce41804 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:30.785412 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-58b8cc61-0a52-4277-9c9f-cdad4ce41804 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:30.793068 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-58b8cc61-0a52-4277-9c9f-cdad4ce41804 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.146852 Dec 20 09:30:30.793630 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 162/368] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:30 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:31.040775 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-01c228b2-ba26-4f7a-be27-1e35aa93ac1c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 4.404176 Dec 20 09:30:31.041992 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 207/369] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:30:26 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 4406 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:30:31.657615 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-81cac198-90ef-4617-b436-8a7d9fd9aedf tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:31.658259 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-81cac198-90ef-4617-b436-8a7d9fd9aedf tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:31.664824 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-81cac198-90ef-4617-b436-8a7d9fd9aedf tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:31.665223 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-81cac198-90ef-4617-b436-8a7d9fd9aedf tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:31.666001 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-81cac198-90ef-4617-b436-8a7d9fd9aedf tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:31.666533 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-81cac198-90ef-4617-b436-8a7d9fd9aedf tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:31.800299 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-81cac198-90ef-4617-b436-8a7d9fd9aedf tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:31.807991 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-81cac198-90ef-4617-b436-8a7d9fd9aedf tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1504 microversion: 2.1 time: 0.154004 Dec 20 09:30:31.808547 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 163/370] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:31 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:31.810082 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7bf6ee64-3ab7-4a14-8963-d000a70e5937 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:31.810775 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7bf6ee64-3ab7-4a14-8963-d000a70e5937 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:31.817724 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7bf6ee64-3ab7-4a14-8963-d000a70e5937 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:31.818195 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7bf6ee64-3ab7-4a14-8963-d000a70e5937 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:31.819029 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7bf6ee64-3ab7-4a14-8963-d000a70e5937 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:31.819496 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7bf6ee64-3ab7-4a14-8963-d000a70e5937 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:31.961626 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7bf6ee64-3ab7-4a14-8963-d000a70e5937 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:31.968778 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7bf6ee64-3ab7-4a14-8963-d000a70e5937 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.163144 Dec 20 09:30:31.969360 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 208/371] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:31 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:32.054483 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c9e64e70-8852-4ce3-9a85-ede0ec75ef2d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:32.055489 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c9e64e70-8852-4ce3-9a85-ede0ec75ef2d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:32.062006 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9e64e70-8852-4ce3-9a85-ede0ec75ef2d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:32.062438 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9e64e70-8852-4ce3-9a85-ede0ec75ef2d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:32.063207 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9e64e70-8852-4ce3-9a85-ede0ec75ef2d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:32.063644 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9e64e70-8852-4ce3-9a85-ede0ec75ef2d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:32.158883 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c9e64e70-8852-4ce3-9a85-ede0ec75ef2d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.108118 Dec 20 09:30:32.164354 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 164/372] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:30:32 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:30:32.824689 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-dcbd3b8b-4612-486b-9b5f-ff2d630b59ce tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:32.825228 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-dcbd3b8b-4612-486b-9b5f-ff2d630b59ce tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:32.831308 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dcbd3b8b-4612-486b-9b5f-ff2d630b59ce tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:32.835262 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dcbd3b8b-4612-486b-9b5f-ff2d630b59ce tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:32.835262 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dcbd3b8b-4612-486b-9b5f-ff2d630b59ce tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:32.835262 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dcbd3b8b-4612-486b-9b5f-ff2d630b59ce tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:32.969033 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-dcbd3b8b-4612-486b-9b5f-ff2d630b59ce tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:32.976560 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-dcbd3b8b-4612-486b-9b5f-ff2d630b59ce tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1504 microversion: 2.1 time: 0.155798 Dec 20 09:30:32.977114 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 209/373] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:32 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:32.985284 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f1d5c826-a461-4432-aeff-31c7e8eeb485 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:32.985985 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f1d5c826-a461-4432-aeff-31c7e8eeb485 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:32.992936 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f1d5c826-a461-4432-aeff-31c7e8eeb485 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:32.993382 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f1d5c826-a461-4432-aeff-31c7e8eeb485 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:32.994150 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f1d5c826-a461-4432-aeff-31c7e8eeb485 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:32.995160 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f1d5c826-a461-4432-aeff-31c7e8eeb485 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:33.129756 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f1d5c826-a461-4432-aeff-31c7e8eeb485 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:33.137415 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f1d5c826-a461-4432-aeff-31c7e8eeb485 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.156092 Dec 20 09:30:33.139553 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 165/374] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:32 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:33.170833 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3ce041e3-74c4-42b8-b07b-663f78975ce0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:33.171856 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-3ce041e3-74c4-42b8-b07b-663f78975ce0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:33.178020 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3ce041e3-74c4-42b8-b07b-663f78975ce0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:33.179760 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3ce041e3-74c4-42b8-b07b-663f78975ce0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:33.179760 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3ce041e3-74c4-42b8-b07b-663f78975ce0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:33.179760 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3ce041e3-74c4-42b8-b07b-663f78975ce0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:33.246000 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3ce041e3-74c4-42b8-b07b-663f78975ce0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.079218 Dec 20 09:30:33.250026 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 210/375] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:30:33 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:30:33.973922 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-8f17e1ba-25fe-40c9-bee2-58a3c5e6e770 req-9521ee60-1491-46bf-8c85-4edae154e497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65142080-4719-4e1f-935c-1da48a98445a", "name": "network-vif-deleted", "tag": "e00c0b94-820e-49f9-967e-8ed64daa49ec"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:33.975723 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:30:33.975723 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:30:33.982827 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-16514a0c-dca6-477a-b56f-911586668f28 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-148256380", "imageRef": "6f828f0b-c445-46a5-9960-492746785ef3", "flavorRef": "452", "networks": [{"uuid": "eda8d65d-a28a-4b39-afdf-98df1672c489"}]}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:33.983685 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-8f17e1ba-25fe-40c9-bee2-58a3c5e6e770 req-9521ee60-1491-46bf-8c85-4edae154e497 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:33.984134 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-8f17e1ba-25fe-40c9-bee2-58a3c5e6e770 req-9521ee60-1491-46bf-8c85-4edae154e497 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:34.003948 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-8f17e1ba-25fe-40c9-bee2-58a3c5e6e770 req-9521ee60-1491-46bf-8c85-4edae154e497 service nova] Creating event network-vif-deleted:e00c0b94-820e-49f9-967e-8ed64daa49ec for instance 65142080-4719-4e1f-935c-1da48a98445a on hv-cinder-81908 Dec 20 09:30:34.003948 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-8f17e1ba-25fe-40c9-bee2-58a3c5e6e770 req-9521ee60-1491-46bf-8c85-4edae154e497 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033635 Dec 20 09:30:34.004614 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 166/376] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:30:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:30:34.009416 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-770a9b7e-41a3-4af2-a8fe-789c914d58dc tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:34.010674 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-770a9b7e-41a3-4af2-a8fe-789c914d58dc tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:34.016819 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-770a9b7e-41a3-4af2-a8fe-789c914d58dc tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:34.017277 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-770a9b7e-41a3-4af2-a8fe-789c914d58dc tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:34.018110 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-770a9b7e-41a3-4af2-a8fe-789c914d58dc tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:34.018548 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-770a9b7e-41a3-4af2-a8fe-789c914d58dc tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:34.083558 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-770a9b7e-41a3-4af2-a8fe-789c914d58dc tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6621c6ec264cad9fe24e1dcfe49ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49197c6143140908f9feb71ef03ce54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:34.094091 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-770a9b7e-41a3-4af2-a8fe-789c914d58dc tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 200 len: 1462 microversion: 2.1 time: 0.088310 Dec 20 09:30:34.099341 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 167/377] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:34 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 1462 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:34.154319 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-69561955-fad9-44c5-a62e-73b9f411537f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:34.154932 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-69561955-fad9-44c5-a62e-73b9f411537f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:34.160766 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-69561955-fad9-44c5-a62e-73b9f411537f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:34.161224 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-69561955-fad9-44c5-a62e-73b9f411537f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:34.161991 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-69561955-fad9-44c5-a62e-73b9f411537f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:34.162478 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-69561955-fad9-44c5-a62e-73b9f411537f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:34.293434 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-69561955-fad9-44c5-a62e-73b9f411537f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:34.303218 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-69561955-fad9-44c5-a62e-73b9f411537f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.152914 Dec 20 09:30:34.304029 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 168/378] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:34 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:34.311217 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-55a95454-7af0-4f23-9a99-a425ca531bff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:34.312207 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-55a95454-7af0-4f23-9a99-a425ca531bff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:34.318366 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-55a95454-7af0-4f23-9a99-a425ca531bff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:34.318813 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-55a95454-7af0-4f23-9a99-a425ca531bff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:34.319630 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-55a95454-7af0-4f23-9a99-a425ca531bff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:34.320110 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-55a95454-7af0-4f23-9a99-a425ca531bff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:34.393299 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-55a95454-7af0-4f23-9a99-a425ca531bff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.088043 Dec 20 09:30:34.393949 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 169/379] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:30:34 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:30:35.115753 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-02465855-d430-4603-9bc5-f5b8d0ece5b0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:35.117009 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-02465855-d430-4603-9bc5-f5b8d0ece5b0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] [instance: 65142080-4719-4e1f-935c-1da48a98445a] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:35.125583 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-02465855-d430-4603-9bc5-f5b8d0ece5b0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:35.126040 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-02465855-d430-4603-9bc5-f5b8d0ece5b0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:35.127325 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-02465855-d430-4603-9bc5-f5b8d0ece5b0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:35.137902 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-02465855-d430-4603-9bc5-f5b8d0ece5b0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:35.144528 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-02465855-d430-4603-9bc5-f5b8d0ece5b0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] HTTP exception thrown: Instance 65142080-4719-4e1f-935c-1da48a98445a could not be found. Dec 20 09:30:35.145128 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-02465855-d430-4603-9bc5-f5b8d0ece5b0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] Returning 404 to user: Instance 65142080-4719-4e1f-935c-1da48a98445a could not be found. {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:30:35.146512 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-02465855-d430-4603-9bc5-f5b8d0ece5b0 tempest-VolumesActionsTest-1135729157 tempest-VolumesActionsTest-1135729157-project] 10.222.0.62 "GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a" status: 404 len: 111 microversion: 2.1 time: 0.035252 Dec 20 09:30:35.147311 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 170/380] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:35 2021] GET /compute/v2.1/servers/65142080-4719-4e1f-935c-1da48a98445a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 20 09:30:35.324130 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ebce1f02-d574-47b2-a4f7-6befd6806740 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:35.324786 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ebce1f02-d574-47b2-a4f7-6befd6806740 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:35.338864 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ebce1f02-d574-47b2-a4f7-6befd6806740 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:35.339548 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ebce1f02-d574-47b2-a4f7-6befd6806740 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:35.340964 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ebce1f02-d574-47b2-a4f7-6befd6806740 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:35.342079 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ebce1f02-d574-47b2-a4f7-6befd6806740 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:35.499180 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ebce1f02-d574-47b2-a4f7-6befd6806740 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:35.505798 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ebce1f02-d574-47b2-a4f7-6befd6806740 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.188558 Dec 20 09:30:35.516014 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 171/381] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:35 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:35.521342 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0127339b-70de-42bd-a0ce-d0aafb3ccdea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:35.523047 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0127339b-70de-42bd-a0ce-d0aafb3ccdea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:35.529374 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0127339b-70de-42bd-a0ce-d0aafb3ccdea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:35.529832 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0127339b-70de-42bd-a0ce-d0aafb3ccdea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:35.530629 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0127339b-70de-42bd-a0ce-d0aafb3ccdea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:35.531064 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0127339b-70de-42bd-a0ce-d0aafb3ccdea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:47.279161 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.network.neutron [None req-16514a0c-dca6-477a-b56f-911586668f28 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] validate_networks() for [('eda8d65d-a28a-4b39-afdf-98df1672c489', None, None, None, None, None)] {{(pid=116674) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 09:30:47.659697 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-16514a0c-dca6-477a-b56f-911586668f28 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Flavor limits 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 09:30:47.660126 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-16514a0c-dca6-477a-b56f-911586668f28 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Image limits 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 09:30:47.660598 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-16514a0c-dca6-477a-b56f-911586668f28 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Flavor pref 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 09:30:47.661012 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-16514a0c-dca6-477a-b56f-911586668f28 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Image pref 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 09:30:47.661422 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-16514a0c-dca6-477a-b56f-911586668f28 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 09:30:47.670638 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-16514a0c-dca6-477a-b56f-911586668f28 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:47.675006 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-16514a0c-dca6-477a-b56f-911586668f28 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:47.675006 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-16514a0c-dca6-477a-b56f-911586668f28 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:47.675006 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-16514a0c-dca6-477a-b56f-911586668f28 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:47.689799 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-16514a0c-dca6-477a-b56f-911586668f28 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Getting quotas for project 24634d5b4d5a42479f08bfb638cdd78d. Resources: {'ram', 'cores', 'instances'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:30:47.699480 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-16514a0c-dca6-477a-b56f-911586668f28 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Getting quotas for user 10a6cc51b90e45d5a484e403dbbab488 and project 24634d5b4d5a42479f08bfb638cdd78d. Resources: {'ram', 'cores', 'instances'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:30:47.711085 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-16514a0c-dca6-477a-b56f-911586668f28 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Going to run 1 instances... {{(pid=116674) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 09:30:47.713596 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-16514a0c-dca6-477a-b56f-911586668f28 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f828f0b-c445-46a5-9960-492746785ef3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 09:30:47.817972 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-16514a0c-dca6-477a-b56f-911586668f28 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.842771 Dec 20 09:30:47.818666 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 211/382] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 20 09:30:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 13844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 20 09:30:47.822771 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-52a3068b-233c-47c3-9bc5-cdd7d0edb202 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:47.824805 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-52a3068b-233c-47c3-9bc5-cdd7d0edb202 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:47.830572 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-52a3068b-233c-47c3-9bc5-cdd7d0edb202 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:47.837334 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-52a3068b-233c-47c3-9bc5-cdd7d0edb202 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:47.838156 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-52a3068b-233c-47c3-9bc5-cdd7d0edb202 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:47.838684 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-52a3068b-233c-47c3-9bc5-cdd7d0edb202 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:47.972487 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-52a3068b-233c-47c3-9bc5-cdd7d0edb202 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:47.980295 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-52a3068b-233c-47c3-9bc5-cdd7d0edb202 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.160186 Dec 20 09:30:47.980870 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 212/383] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:47 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:47.985062 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f7518eef-c1a7-43f2-a10d-b557e36eea51 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:47.985657 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f7518eef-c1a7-43f2-a10d-b557e36eea51 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:48.035011 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f7518eef-c1a7-43f2-a10d-b557e36eea51 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:48.041463 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f7518eef-c1a7-43f2-a10d-b557e36eea51 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1217 microversion: 2.1 time: 0.059663 Dec 20 09:30:48.042072 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 213/384] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:47 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1217 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:48.997174 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-70f3d6d8-38c3-4093-9a38-d47ef9d07ab1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:48.997809 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-70f3d6d8-38c3-4093-9a38-d47ef9d07ab1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:49.004373 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-70f3d6d8-38c3-4093-9a38-d47ef9d07ab1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:49.004824 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-70f3d6d8-38c3-4093-9a38-d47ef9d07ab1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:49.005631 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-70f3d6d8-38c3-4093-9a38-d47ef9d07ab1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:49.006070 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-70f3d6d8-38c3-4093-9a38-d47ef9d07ab1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:49.134928 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-70f3d6d8-38c3-4093-9a38-d47ef9d07ab1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:49.142803 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-70f3d6d8-38c3-4093-9a38-d47ef9d07ab1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.149830 Dec 20 09:30:49.143363 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 214/385] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:48 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:49.147504 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ae7f5a74-9198-44be-8679-978caf102b3a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:49.148130 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ae7f5a74-9198-44be-8679-978caf102b3a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:49.153609 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ae7f5a74-9198-44be-8679-978caf102b3a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:49.154060 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ae7f5a74-9198-44be-8679-978caf102b3a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:49.154993 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ae7f5a74-9198-44be-8679-978caf102b3a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:49.155335 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ae7f5a74-9198-44be-8679-978caf102b3a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:49.212806 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ae7f5a74-9198-44be-8679-978caf102b3a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:49.220017 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ae7f5a74-9198-44be-8679-978caf102b3a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1221 microversion: 2.1 time: 0.075656 Dec 20 09:30:49.220584 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 215/386] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:49 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1221 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:50.158284 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-607c65bd-fc48-47b2-bae5-898f2a34fa1a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:50.158881 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-607c65bd-fc48-47b2-bae5-898f2a34fa1a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:50.165125 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-607c65bd-fc48-47b2-bae5-898f2a34fa1a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:50.165564 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-607c65bd-fc48-47b2-bae5-898f2a34fa1a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:50.166323 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-607c65bd-fc48-47b2-bae5-898f2a34fa1a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:50.166752 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-607c65bd-fc48-47b2-bae5-898f2a34fa1a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:50.291954 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-607c65bd-fc48-47b2-bae5-898f2a34fa1a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:50.299079 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-607c65bd-fc48-47b2-bae5-898f2a34fa1a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.144424 Dec 20 09:30:50.299637 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 216/387] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:50 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:50.303751 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d2b39f62-7471-4659-aae0-2c957791c136 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:50.304344 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d2b39f62-7471-4659-aae0-2c957791c136 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:50.310362 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d2b39f62-7471-4659-aae0-2c957791c136 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:50.310805 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d2b39f62-7471-4659-aae0-2c957791c136 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:50.311810 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d2b39f62-7471-4659-aae0-2c957791c136 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:50.312251 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d2b39f62-7471-4659-aae0-2c957791c136 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:50.368985 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d2b39f62-7471-4659-aae0-2c957791c136 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:50.376720 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d2b39f62-7471-4659-aae0-2c957791c136 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1221 microversion: 2.1 time: 0.076144 Dec 20 09:30:50.377535 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 217/388] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:50 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1221 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:50.806559 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0127339b-70de-42bd-a0ce-d0aafb3ccdea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 15.288850 Dec 20 09:30:50.807123 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 172/389] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:30:35 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 15290 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:30:51.316114 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-55f8c90f-3e25-4741-942b-be7edfee3dc1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:51.316741 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-55f8c90f-3e25-4741-942b-be7edfee3dc1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:51.323154 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-55f8c90f-3e25-4741-942b-be7edfee3dc1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:51.324247 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-55f8c90f-3e25-4741-942b-be7edfee3dc1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:51.325228 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-55f8c90f-3e25-4741-942b-be7edfee3dc1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:51.325658 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-55f8c90f-3e25-4741-942b-be7edfee3dc1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:51.393928 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ff49dbaf-80a2-4490-9525-1c7cbab6843e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:51.394630 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ff49dbaf-80a2-4490-9525-1c7cbab6843e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:51.402058 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ff49dbaf-80a2-4490-9525-1c7cbab6843e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:51.402506 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ff49dbaf-80a2-4490-9525-1c7cbab6843e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:51.403290 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ff49dbaf-80a2-4490-9525-1c7cbab6843e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:51.403880 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ff49dbaf-80a2-4490-9525-1c7cbab6843e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:51.493561 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ff49dbaf-80a2-4490-9525-1c7cbab6843e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:51.501475 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-55f8c90f-3e25-4741-942b-be7edfee3dc1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:51.501633 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ff49dbaf-80a2-4490-9525-1c7cbab6843e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1269 microversion: 2.1 time: 0.111738 Dec 20 09:30:51.502323 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 173/390] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:51 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1269 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:51.509281 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-55f8c90f-3e25-4741-942b-be7edfee3dc1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.196768 Dec 20 09:30:51.509833 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 218/391] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:51 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:51.818682 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-42e8fca3-3cc1-420a-a8c4-c034e87d91ea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:51.819500 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-42e8fca3-3cc1-420a-a8c4-c034e87d91ea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:51.827184 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-42e8fca3-3cc1-420a-a8c4-c034e87d91ea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:51.827727 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-42e8fca3-3cc1-420a-a8c4-c034e87d91ea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:51.828535 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-42e8fca3-3cc1-420a-a8c4-c034e87d91ea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:51.829135 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-42e8fca3-3cc1-420a-a8c4-c034e87d91ea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:52.068527 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-42e8fca3-3cc1-420a-a8c4-c034e87d91ea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.253657 Dec 20 09:30:52.069268 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 174/392] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:30:51 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:30:52.518142 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-84cae696-5d45-4d80-b1c2-89e3cea9a413 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:52.518758 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-84cae696-5d45-4d80-b1c2-89e3cea9a413 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:52.525986 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-003dc55f-e096-46cd-98e2-d2110ea69bcd tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:52.527181 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-003dc55f-e096-46cd-98e2-d2110ea69bcd tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:52.534199 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-003dc55f-e096-46cd-98e2-d2110ea69bcd tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:52.534656 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-003dc55f-e096-46cd-98e2-d2110ea69bcd tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:52.535371 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84cae696-5d45-4d80-b1c2-89e3cea9a413 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:52.535501 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-003dc55f-e096-46cd-98e2-d2110ea69bcd tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:52.535860 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84cae696-5d45-4d80-b1c2-89e3cea9a413 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:52.535995 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-003dc55f-e096-46cd-98e2-d2110ea69bcd tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:52.536643 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84cae696-5d45-4d80-b1c2-89e3cea9a413 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:52.537079 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84cae696-5d45-4d80-b1c2-89e3cea9a413 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:52.603560 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-84cae696-5d45-4d80-b1c2-89e3cea9a413 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:52.618471 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-84cae696-5d45-4d80-b1c2-89e3cea9a413 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1275 microversion: 2.1 time: 0.104011 Dec 20 09:30:52.619052 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 219/393] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:52 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1275 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:52.722824 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-003dc55f-e096-46cd-98e2-d2110ea69bcd tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:52.730798 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-003dc55f-e096-46cd-98e2-d2110ea69bcd tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.208740 Dec 20 09:30:52.731354 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 175/394] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:52 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:53.079958 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f22a2fc2-5bd7-480f-b87e-95ab77ac9cfd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:53.080923 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f22a2fc2-5bd7-480f-b87e-95ab77ac9cfd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:53.086723 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f22a2fc2-5bd7-480f-b87e-95ab77ac9cfd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:53.087162 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f22a2fc2-5bd7-480f-b87e-95ab77ac9cfd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:53.087956 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f22a2fc2-5bd7-480f-b87e-95ab77ac9cfd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:53.088433 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f22a2fc2-5bd7-480f-b87e-95ab77ac9cfd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:53.635241 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-63d408f7-7ddb-4949-b648-e49410becfa0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:53.635897 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-63d408f7-7ddb-4949-b648-e49410becfa0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:53.642125 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-63d408f7-7ddb-4949-b648-e49410becfa0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:53.642632 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-63d408f7-7ddb-4949-b648-e49410becfa0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:53.643415 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-63d408f7-7ddb-4949-b648-e49410becfa0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:53.643886 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-63d408f7-7ddb-4949-b648-e49410becfa0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:53.795377 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-63d408f7-7ddb-4949-b648-e49410becfa0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:53.802513 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-63d408f7-7ddb-4949-b648-e49410becfa0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.170916 Dec 20 09:30:53.803091 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 176/395] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:53 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:53.807192 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c0ee7f09-7aed-4315-970d-879eb689cebf tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:53.807813 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c0ee7f09-7aed-4315-970d-879eb689cebf tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:53.813175 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c0ee7f09-7aed-4315-970d-879eb689cebf tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:53.813627 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c0ee7f09-7aed-4315-970d-879eb689cebf tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:53.814401 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c0ee7f09-7aed-4315-970d-879eb689cebf tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:53.814839 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c0ee7f09-7aed-4315-970d-879eb689cebf tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:53.946494 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-c0ee7f09-7aed-4315-970d-879eb689cebf tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:53.954170 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c0ee7f09-7aed-4315-970d-879eb689cebf tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.150161 Dec 20 09:30:53.954724 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 177/396] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:53 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:54.818571 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8bff5b12-c59a-4f1c-9b46-095f0fb07b1b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:54.819186 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8bff5b12-c59a-4f1c-9b46-095f0fb07b1b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:54.825967 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8bff5b12-c59a-4f1c-9b46-095f0fb07b1b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:54.826420 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8bff5b12-c59a-4f1c-9b46-095f0fb07b1b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:54.827194 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8bff5b12-c59a-4f1c-9b46-095f0fb07b1b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:54.827632 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8bff5b12-c59a-4f1c-9b46-095f0fb07b1b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:54.952840 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8bff5b12-c59a-4f1c-9b46-095f0fb07b1b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:54.959931 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8bff5b12-c59a-4f1c-9b46-095f0fb07b1b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.144940 Dec 20 09:30:54.960499 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 178/397] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:54 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:54.969511 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e568803b-f227-4cc2-9498-5ca7d9c94bf4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:54.970113 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e568803b-f227-4cc2-9498-5ca7d9c94bf4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:54.975892 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e568803b-f227-4cc2-9498-5ca7d9c94bf4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:54.976328 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e568803b-f227-4cc2-9498-5ca7d9c94bf4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:54.977103 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e568803b-f227-4cc2-9498-5ca7d9c94bf4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:54.977542 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e568803b-f227-4cc2-9498-5ca7d9c94bf4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:55.114836 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e568803b-f227-4cc2-9498-5ca7d9c94bf4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:55.122586 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e568803b-f227-4cc2-9498-5ca7d9c94bf4 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.156369 Dec 20 09:30:55.123374 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 179/398] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:54 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:55.715645 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-e746108f-3bdd-4a4f-8295-1578b7c03950 req-38b93a91-41d5-471d-9e92-fa5b7a40584b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ad12943-79b4-4049-98a9-0a88b6cb199d", "tag": "91f40bfa-c185-4389-a36a-95ea7e7071de"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:30:55.717222 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:30:55.717222 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:30:55.723861 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-e746108f-3bdd-4a4f-8295-1578b7c03950 req-38b93a91-41d5-471d-9e92-fa5b7a40584b service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:55.724306 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-e746108f-3bdd-4a4f-8295-1578b7c03950 req-38b93a91-41d5-471d-9e92-fa5b7a40584b service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:55.737286 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-e746108f-3bdd-4a4f-8295-1578b7c03950 req-38b93a91-41d5-471d-9e92-fa5b7a40584b service nova] Creating event network-changed:91f40bfa-c185-4389-a36a-95ea7e7071de for instance 4ad12943-79b4-4049-98a9-0a88b6cb199d on hv-cinder-81908 Dec 20 09:30:55.741923 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-e746108f-3bdd-4a4f-8295-1578b7c03950 req-38b93a91-41d5-471d-9e92-fa5b7a40584b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030538 Dec 20 09:30:55.742514 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 180/399] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:30:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:30:55.976957 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-cb2eeb33-6fac-42bf-b371-f13628697253 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:55.977653 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-cb2eeb33-6fac-42bf-b371-f13628697253 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:55.984209 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cb2eeb33-6fac-42bf-b371-f13628697253 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:55.984658 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cb2eeb33-6fac-42bf-b371-f13628697253 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:55.985424 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cb2eeb33-6fac-42bf-b371-f13628697253 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:55.985853 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cb2eeb33-6fac-42bf-b371-f13628697253 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:56.116868 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-cb2eeb33-6fac-42bf-b371-f13628697253 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:56.124273 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-cb2eeb33-6fac-42bf-b371-f13628697253 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.151428 Dec 20 09:30:56.125177 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 181/400] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:55 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:56.139549 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-3286f6be-a986-4646-a63d-3645c997d4b7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:56.140168 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-3286f6be-a986-4646-a63d-3645c997d4b7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:56.145915 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3286f6be-a986-4646-a63d-3645c997d4b7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:56.146356 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3286f6be-a986-4646-a63d-3645c997d4b7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:56.147113 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3286f6be-a986-4646-a63d-3645c997d4b7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:56.147541 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3286f6be-a986-4646-a63d-3645c997d4b7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:56.272058 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-3286f6be-a986-4646-a63d-3645c997d4b7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:56.279773 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-3286f6be-a986-4646-a63d-3645c997d4b7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.144161 Dec 20 09:30:56.280338 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 182/401] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:56 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:57.141078 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-023ded12-773d-4e9e-b2d3-5a69eb37847b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:57.141781 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-023ded12-773d-4e9e-b2d3-5a69eb37847b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:57.147813 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-023ded12-773d-4e9e-b2d3-5a69eb37847b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:57.148267 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-023ded12-773d-4e9e-b2d3-5a69eb37847b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:57.149045 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-023ded12-773d-4e9e-b2d3-5a69eb37847b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:57.149480 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-023ded12-773d-4e9e-b2d3-5a69eb37847b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:57.283286 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-023ded12-773d-4e9e-b2d3-5a69eb37847b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:57.290546 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-023ded12-773d-4e9e-b2d3-5a69eb37847b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.153182 Dec 20 09:30:57.291116 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 183/402] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:57 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:57.295785 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9b5d78cb-ecbe-40a8-8e95-74a8fb0898a3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:57.297012 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9b5d78cb-ecbe-40a8-8e95-74a8fb0898a3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:57.302505 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9b5d78cb-ecbe-40a8-8e95-74a8fb0898a3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:57.302975 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9b5d78cb-ecbe-40a8-8e95-74a8fb0898a3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:57.303787 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9b5d78cb-ecbe-40a8-8e95-74a8fb0898a3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:57.304224 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9b5d78cb-ecbe-40a8-8e95-74a8fb0898a3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:57.436427 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-9b5d78cb-ecbe-40a8-8e95-74a8fb0898a3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:57.443723 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9b5d78cb-ecbe-40a8-8e95-74a8fb0898a3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.151129 Dec 20 09:30:57.444290 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 184/403] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:57 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:58.305890 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f2e95344-3c26-4c42-afde-614a4c1f11bb tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:58.306468 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f2e95344-3c26-4c42-afde-614a4c1f11bb tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:58.313223 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f2e95344-3c26-4c42-afde-614a4c1f11bb tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:58.313662 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f2e95344-3c26-4c42-afde-614a4c1f11bb tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:58.314422 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f2e95344-3c26-4c42-afde-614a4c1f11bb tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:58.314848 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f2e95344-3c26-4c42-afde-614a4c1f11bb tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:58.441016 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f2e95344-3c26-4c42-afde-614a4c1f11bb tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:58.448195 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f2e95344-3c26-4c42-afde-614a4c1f11bb tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.145927 Dec 20 09:30:58.448748 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 185/404] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:58 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:58.459122 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-dcbf5496-efde-4bb0-a388-fc3b96742c5c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:58.459742 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-dcbf5496-efde-4bb0-a388-fc3b96742c5c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:58.465238 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-dcbf5496-efde-4bb0-a388-fc3b96742c5c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:58.465681 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-dcbf5496-efde-4bb0-a388-fc3b96742c5c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:58.466444 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-dcbf5496-efde-4bb0-a388-fc3b96742c5c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:58.466882 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-dcbf5496-efde-4bb0-a388-fc3b96742c5c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:58.595490 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-dcbf5496-efde-4bb0-a388-fc3b96742c5c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:58.602679 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-dcbf5496-efde-4bb0-a388-fc3b96742c5c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.146975 Dec 20 09:30:58.603239 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 186/405] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:58 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:30:59.161040 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f22a2fc2-5bd7-480f-b87e-95ab77ac9cfd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 6.084538 Dec 20 09:30:59.164994 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 220/406] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:30:53 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 6086 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:30:59.464451 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-28297f7c-3a5f-4ef3-9424-0a99dff255d2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:59.465091 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-28297f7c-3a5f-4ef3-9424-0a99dff255d2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:59.471512 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-28297f7c-3a5f-4ef3-9424-0a99dff255d2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:59.472003 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-28297f7c-3a5f-4ef3-9424-0a99dff255d2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:59.472796 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-28297f7c-3a5f-4ef3-9424-0a99dff255d2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:59.473234 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-28297f7c-3a5f-4ef3-9424-0a99dff255d2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:59.603324 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-28297f7c-3a5f-4ef3-9424-0a99dff255d2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:59.611013 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-28297f7c-3a5f-4ef3-9424-0a99dff255d2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.150237 Dec 20 09:30:59.611611 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 187/407] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:59 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:30:59.621809 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ef65d4b1-e3fe-419c-a395-60b7e5043d5c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:30:59.623372 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ef65d4b1-e3fe-419c-a395-60b7e5043d5c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:30:59.634521 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ef65d4b1-e3fe-419c-a395-60b7e5043d5c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:59.635016 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ef65d4b1-e3fe-419c-a395-60b7e5043d5c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:59.636637 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ef65d4b1-e3fe-419c-a395-60b7e5043d5c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:30:59.637098 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ef65d4b1-e3fe-419c-a395-60b7e5043d5c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:30:59.788851 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ef65d4b1-e3fe-419c-a395-60b7e5043d5c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:30:59.797107 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ef65d4b1-e3fe-419c-a395-60b7e5043d5c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.180424 Dec 20 09:30:59.797683 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 221/408] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:30:59 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:00.173114 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9af5801c-5462-4776-a446-eb2d28d72c9c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:00.174037 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9af5801c-5462-4776-a446-eb2d28d72c9c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:00.179951 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9af5801c-5462-4776-a446-eb2d28d72c9c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:00.183265 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9af5801c-5462-4776-a446-eb2d28d72c9c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:00.183265 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9af5801c-5462-4776-a446-eb2d28d72c9c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:00.183265 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9af5801c-5462-4776-a446-eb2d28d72c9c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:00.480765 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9af5801c-5462-4776-a446-eb2d28d72c9c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.311153 Dec 20 09:31:00.482081 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 188/409] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:00 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:31:00.628614 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e13b6572-92d8-4476-a934-3581a2141c1d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:00.629151 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e13b6572-92d8-4476-a934-3581a2141c1d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:00.635947 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e13b6572-92d8-4476-a934-3581a2141c1d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:00.636393 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e13b6572-92d8-4476-a934-3581a2141c1d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:00.637172 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e13b6572-92d8-4476-a934-3581a2141c1d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:00.637608 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e13b6572-92d8-4476-a934-3581a2141c1d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:00.764301 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e13b6572-92d8-4476-a934-3581a2141c1d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:00.771687 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e13b6572-92d8-4476-a934-3581a2141c1d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.147065 Dec 20 09:31:00.772275 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 222/410] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:00 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:00.814422 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9776a4fc-0b91-4ce2-9fec-a73c0b9c71db tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:00.815151 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9776a4fc-0b91-4ce2-9fec-a73c0b9c71db tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:00.821993 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9776a4fc-0b91-4ce2-9fec-a73c0b9c71db tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:00.822442 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9776a4fc-0b91-4ce2-9fec-a73c0b9c71db tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:00.823912 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9776a4fc-0b91-4ce2-9fec-a73c0b9c71db tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:00.824350 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9776a4fc-0b91-4ce2-9fec-a73c0b9c71db tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:00.959909 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-9776a4fc-0b91-4ce2-9fec-a73c0b9c71db tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:00.967293 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9776a4fc-0b91-4ce2-9fec-a73c0b9c71db tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.156947 Dec 20 09:31:00.967890 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 189/411] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:00 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:01.492093 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b1c6d2a5-fd24-4938-a87b-d2dadc8f3f30 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:01.493155 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b1c6d2a5-fd24-4938-a87b-d2dadc8f3f30 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:01.500103 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b1c6d2a5-fd24-4938-a87b-d2dadc8f3f30 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:01.500550 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b1c6d2a5-fd24-4938-a87b-d2dadc8f3f30 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:01.501330 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b1c6d2a5-fd24-4938-a87b-d2dadc8f3f30 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:01.502020 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b1c6d2a5-fd24-4938-a87b-d2dadc8f3f30 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:01.658072 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b1c6d2a5-fd24-4938-a87b-d2dadc8f3f30 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.169435 Dec 20 09:31:01.658729 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 223/412] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:01 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:31:01.788982 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-5e2c8cbb-6e2a-4591-b8c5-4ed69863182b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:01.789675 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-5e2c8cbb-6e2a-4591-b8c5-4ed69863182b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:01.796275 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5e2c8cbb-6e2a-4591-b8c5-4ed69863182b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:01.796733 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5e2c8cbb-6e2a-4591-b8c5-4ed69863182b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:01.797520 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5e2c8cbb-6e2a-4591-b8c5-4ed69863182b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:01.797978 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5e2c8cbb-6e2a-4591-b8c5-4ed69863182b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:01.946659 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-5e2c8cbb-6e2a-4591-b8c5-4ed69863182b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:01.954763 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-5e2c8cbb-6e2a-4591-b8c5-4ed69863182b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.169849 Dec 20 09:31:01.955423 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 190/413] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:01 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:01.984998 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7668dc49-c8a8-471e-8d26-eb91eb1bb99a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:01.985751 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7668dc49-c8a8-471e-8d26-eb91eb1bb99a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:01.992702 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7668dc49-c8a8-471e-8d26-eb91eb1bb99a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:01.996365 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7668dc49-c8a8-471e-8d26-eb91eb1bb99a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:01.996365 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7668dc49-c8a8-471e-8d26-eb91eb1bb99a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:01.996365 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7668dc49-c8a8-471e-8d26-eb91eb1bb99a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:02.137366 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7668dc49-c8a8-471e-8d26-eb91eb1bb99a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:02.145023 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7668dc49-c8a8-471e-8d26-eb91eb1bb99a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.164003 Dec 20 09:31:02.145599 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 224/414] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:01 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:02.670210 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-68334f2b-690a-4988-924d-eaf959185a4d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:02.671407 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-68334f2b-690a-4988-924d-eaf959185a4d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:02.679911 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-68334f2b-690a-4988-924d-eaf959185a4d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:02.680217 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-68334f2b-690a-4988-924d-eaf959185a4d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:02.681000 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-68334f2b-690a-4988-924d-eaf959185a4d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:02.681434 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-68334f2b-690a-4988-924d-eaf959185a4d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:02.971628 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c4308d7f-82fb-49ce-83c1-41adc43d9429 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:02.972339 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c4308d7f-82fb-49ce-83c1-41adc43d9429 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:02.978994 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c4308d7f-82fb-49ce-83c1-41adc43d9429 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:02.979676 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c4308d7f-82fb-49ce-83c1-41adc43d9429 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:02.980642 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c4308d7f-82fb-49ce-83c1-41adc43d9429 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:02.981073 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c4308d7f-82fb-49ce-83c1-41adc43d9429 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:03.136743 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-c4308d7f-82fb-49ce-83c1-41adc43d9429 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:03.148544 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c4308d7f-82fb-49ce-83c1-41adc43d9429 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.180500 Dec 20 09:31:03.149264 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 225/415] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:02 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:03.161687 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-71e653cc-eece-493d-ab6b-cd8f6857d13d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:03.162297 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-71e653cc-eece-493d-ab6b-cd8f6857d13d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:03.171717 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-71e653cc-eece-493d-ab6b-cd8f6857d13d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:03.172328 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-71e653cc-eece-493d-ab6b-cd8f6857d13d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:03.173582 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-71e653cc-eece-493d-ab6b-cd8f6857d13d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:03.174125 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-71e653cc-eece-493d-ab6b-cd8f6857d13d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:03.329015 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-71e653cc-eece-493d-ab6b-cd8f6857d13d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:03.337476 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-71e653cc-eece-493d-ab6b-cd8f6857d13d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.179636 Dec 20 09:31:03.338356 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 226/416] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:03 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:04.166962 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d046ac57-eaea-4cba-b2fa-f57038cc5c02 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:04.168544 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d046ac57-eaea-4cba-b2fa-f57038cc5c02 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:04.176863 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d046ac57-eaea-4cba-b2fa-f57038cc5c02 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:04.177460 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d046ac57-eaea-4cba-b2fa-f57038cc5c02 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:04.178288 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d046ac57-eaea-4cba-b2fa-f57038cc5c02 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:04.178720 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d046ac57-eaea-4cba-b2fa-f57038cc5c02 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:04.321447 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d046ac57-eaea-4cba-b2fa-f57038cc5c02 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:04.329785 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d046ac57-eaea-4cba-b2fa-f57038cc5c02 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.166953 Dec 20 09:31:04.330457 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 227/417] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:04 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:04.355878 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-555c1f01-b709-4b79-9c95-bac1f9ea884a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:04.356487 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-555c1f01-b709-4b79-9c95-bac1f9ea884a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:04.362548 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-555c1f01-b709-4b79-9c95-bac1f9ea884a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:04.362994 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-555c1f01-b709-4b79-9c95-bac1f9ea884a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:04.363804 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-555c1f01-b709-4b79-9c95-bac1f9ea884a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:04.364240 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-555c1f01-b709-4b79-9c95-bac1f9ea884a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:04.539151 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-555c1f01-b709-4b79-9c95-bac1f9ea884a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:04.547249 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-555c1f01-b709-4b79-9c95-bac1f9ea884a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.195540 Dec 20 09:31:04.548052 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 228/418] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:04 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:05.347123 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-81a6ee0f-4863-4bf2-a167-09abef07fff4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:05.347914 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-81a6ee0f-4863-4bf2-a167-09abef07fff4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:05.354206 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-81a6ee0f-4863-4bf2-a167-09abef07fff4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:05.354912 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-81a6ee0f-4863-4bf2-a167-09abef07fff4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:05.355723 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-81a6ee0f-4863-4bf2-a167-09abef07fff4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:05.356467 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-81a6ee0f-4863-4bf2-a167-09abef07fff4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:05.502010 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-81a6ee0f-4863-4bf2-a167-09abef07fff4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:05.509776 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-81a6ee0f-4863-4bf2-a167-09abef07fff4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.166380 Dec 20 09:31:05.510676 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 229/419] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:05 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:05.563080 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-2820f9a3-45b7-4238-a885-b87b055ab8d6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:05.564106 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-2820f9a3-45b7-4238-a885-b87b055ab8d6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:05.570242 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2820f9a3-45b7-4238-a885-b87b055ab8d6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:05.575198 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2820f9a3-45b7-4238-a885-b87b055ab8d6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:05.575198 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2820f9a3-45b7-4238-a885-b87b055ab8d6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:05.575198 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2820f9a3-45b7-4238-a885-b87b055ab8d6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:05.706006 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-2820f9a3-45b7-4238-a885-b87b055ab8d6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:05.713405 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-2820f9a3-45b7-4238-a885-b87b055ab8d6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.154149 Dec 20 09:31:05.714606 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 230/420] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:05 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:06.526081 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a1a83c46-2d8c-484e-a6a9-79fa0416079e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:06.526773 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a1a83c46-2d8c-484e-a6a9-79fa0416079e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:06.534234 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a1a83c46-2d8c-484e-a6a9-79fa0416079e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:06.534728 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a1a83c46-2d8c-484e-a6a9-79fa0416079e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:06.535488 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a1a83c46-2d8c-484e-a6a9-79fa0416079e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:06.535954 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a1a83c46-2d8c-484e-a6a9-79fa0416079e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:06.702037 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a1a83c46-2d8c-484e-a6a9-79fa0416079e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:06.709467 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a1a83c46-2d8c-484e-a6a9-79fa0416079e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.187069 Dec 20 09:31:06.710193 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 231/421] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:06 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:06.730772 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-06c1f4d6-e940-49b0-8e44-25d9656e2d73 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:06.731642 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-06c1f4d6-e940-49b0-8e44-25d9656e2d73 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:06.737806 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-06c1f4d6-e940-49b0-8e44-25d9656e2d73 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:06.738452 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-06c1f4d6-e940-49b0-8e44-25d9656e2d73 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:06.739467 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-06c1f4d6-e940-49b0-8e44-25d9656e2d73 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:06.739934 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-06c1f4d6-e940-49b0-8e44-25d9656e2d73 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:06.882253 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-06c1f4d6-e940-49b0-8e44-25d9656e2d73 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:06.892663 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-06c1f4d6-e940-49b0-8e44-25d9656e2d73 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.166215 Dec 20 09:31:06.895726 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 232/422] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:06 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:07.725856 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-434a13e7-af2f-4062-9fec-f2dd54d084c1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:07.726592 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-434a13e7-af2f-4062-9fec-f2dd54d084c1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:07.733665 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-434a13e7-af2f-4062-9fec-f2dd54d084c1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:07.734113 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-434a13e7-af2f-4062-9fec-f2dd54d084c1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:07.734899 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-434a13e7-af2f-4062-9fec-f2dd54d084c1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:07.735329 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-434a13e7-af2f-4062-9fec-f2dd54d084c1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:07.750378 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-68334f2b-690a-4988-924d-eaf959185a4d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 5.083959 Dec 20 09:31:07.756687 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 191/423] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:02 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 5091 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:31:07.889714 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-434a13e7-af2f-4062-9fec-f2dd54d084c1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:07.897418 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-434a13e7-af2f-4062-9fec-f2dd54d084c1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.175208 Dec 20 09:31:07.898009 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 233/424] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:07 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:07.921036 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0d350183-51a5-4870-bb3c-e25e7f08e3a5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:07.921737 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0d350183-51a5-4870-bb3c-e25e7f08e3a5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:07.932109 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0d350183-51a5-4870-bb3c-e25e7f08e3a5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:07.933671 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0d350183-51a5-4870-bb3c-e25e7f08e3a5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:07.934768 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0d350183-51a5-4870-bb3c-e25e7f08e3a5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:07.935580 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0d350183-51a5-4870-bb3c-e25e7f08e3a5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:08.121882 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-0d350183-51a5-4870-bb3c-e25e7f08e3a5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:08.132035 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0d350183-51a5-4870-bb3c-e25e7f08e3a5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.222640 Dec 20 09:31:08.132742 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 192/425] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:07 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:08.763172 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-55a3514a-af75-45b3-b0dd-e8c060a65a55 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:08.764525 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-55a3514a-af75-45b3-b0dd-e8c060a65a55 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:08.771057 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-55a3514a-af75-45b3-b0dd-e8c060a65a55 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:08.771496 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-55a3514a-af75-45b3-b0dd-e8c060a65a55 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:08.772298 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-55a3514a-af75-45b3-b0dd-e8c060a65a55 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:08.772896 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-55a3514a-af75-45b3-b0dd-e8c060a65a55 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:08.914078 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-09870f9f-6f46-4770-ae48-ff2a65d30cef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:08.914682 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-09870f9f-6f46-4770-ae48-ff2a65d30cef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:08.923786 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-09870f9f-6f46-4770-ae48-ff2a65d30cef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:08.924676 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-09870f9f-6f46-4770-ae48-ff2a65d30cef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:08.925680 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-09870f9f-6f46-4770-ae48-ff2a65d30cef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:08.926356 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-09870f9f-6f46-4770-ae48-ff2a65d30cef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:08.936857 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-55a3514a-af75-45b3-b0dd-e8c060a65a55 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.177824 Dec 20 09:31:08.941314 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 234/426] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:08 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:31:09.125405 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-09870f9f-6f46-4770-ae48-ff2a65d30cef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:09.133755 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-09870f9f-6f46-4770-ae48-ff2a65d30cef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.223213 Dec 20 09:31:09.144289 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 193/427] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:08 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:09.149677 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-35584e7b-6d5b-4711-b712-537bbf4650ad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:09.150393 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-35584e7b-6d5b-4711-b712-537bbf4650ad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:09.157415 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-35584e7b-6d5b-4711-b712-537bbf4650ad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:09.157853 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-35584e7b-6d5b-4711-b712-537bbf4650ad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:09.158636 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-35584e7b-6d5b-4711-b712-537bbf4650ad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:09.159079 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-35584e7b-6d5b-4711-b712-537bbf4650ad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:09.303171 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-35584e7b-6d5b-4711-b712-537bbf4650ad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:09.310930 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-35584e7b-6d5b-4711-b712-537bbf4650ad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.165886 Dec 20 09:31:09.311487 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 235/428] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:09 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:09.949998 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-5e9ff8ca-0bcb-44bc-be05-912e1e08afb6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:09.951815 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-5e9ff8ca-0bcb-44bc-be05-912e1e08afb6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:09.962984 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5e9ff8ca-0bcb-44bc-be05-912e1e08afb6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:09.963621 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5e9ff8ca-0bcb-44bc-be05-912e1e08afb6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:09.965261 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5e9ff8ca-0bcb-44bc-be05-912e1e08afb6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:09.965929 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5e9ff8ca-0bcb-44bc-be05-912e1e08afb6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:10.049832 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-5e9ff8ca-0bcb-44bc-be05-912e1e08afb6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.103866 Dec 20 09:31:10.050741 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 194/429] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:09 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:31:10.151158 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a88d3cbf-0aed-4e62-9a50-3c0ec6fbe1e4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:10.153406 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a88d3cbf-0aed-4e62-9a50-3c0ec6fbe1e4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:10.162397 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a88d3cbf-0aed-4e62-9a50-3c0ec6fbe1e4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:10.163387 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a88d3cbf-0aed-4e62-9a50-3c0ec6fbe1e4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:10.164387 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a88d3cbf-0aed-4e62-9a50-3c0ec6fbe1e4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:10.164913 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a88d3cbf-0aed-4e62-9a50-3c0ec6fbe1e4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:10.315490 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a88d3cbf-0aed-4e62-9a50-3c0ec6fbe1e4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:10.329349 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a88d3cbf-0aed-4e62-9a50-3c0ec6fbe1e4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.182648 Dec 20 09:31:10.329695 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-7eb7a506-5e1d-4613-a1f3-c826000cd2fa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:10.330599 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 236/430] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:10 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:10.330894 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-7eb7a506-5e1d-4613-a1f3-c826000cd2fa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:10.342453 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7eb7a506-5e1d-4613-a1f3-c826000cd2fa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:10.343489 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7eb7a506-5e1d-4613-a1f3-c826000cd2fa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:10.345216 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7eb7a506-5e1d-4613-a1f3-c826000cd2fa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:10.345811 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7eb7a506-5e1d-4613-a1f3-c826000cd2fa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:10.544130 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-7eb7a506-5e1d-4613-a1f3-c826000cd2fa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:10.552479 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-7eb7a506-5e1d-4613-a1f3-c826000cd2fa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1501 microversion: 2.1 time: 0.227880 Dec 20 09:31:10.553054 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 195/431] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:10 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1501 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:10.569482 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f8e3533c-dd19-4e00-9d3d-14cc9306cbcc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41bc9178-7a40-448b-96de-8e6a55ac7d06"}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:10.570807 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f8e3533c-dd19-4e00-9d3d-14cc9306cbcc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:10.577866 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f8e3533c-dd19-4e00-9d3d-14cc9306cbcc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:10.578508 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f8e3533c-dd19-4e00-9d3d-14cc9306cbcc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:10.579458 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f8e3533c-dd19-4e00-9d3d-14cc9306cbcc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:10.580080 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f8e3533c-dd19-4e00-9d3d-14cc9306cbcc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:10.605778 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.wsgi [None req-f8e3533c-dd19-4e00-9d3d-14cc9306cbcc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] HTTP exception thrown: Cannot 'attach_volume' instance 1af8e934-5860-485f-abf5-42a2814d66e7 while it is in vm_state rescued Dec 20 09:31:10.606666 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f8e3533c-dd19-4e00-9d3d-14cc9306cbcc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Returning 409 to user: Cannot 'attach_volume' instance 1af8e934-5860-485f-abf5-42a2814d66e7 while it is in vm_state rescued {{(pid=116674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:31:10.607506 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f8e3533c-dd19-4e00-9d3d-14cc9306cbcc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "POST /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041927 Dec 20 09:31:10.608395 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 237/432] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 20 09:31:10 2021] POST /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 20 09:31:10.616572 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b8c4707e-ff3b-40ac-a87f-7261d14872b1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:10.619120 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b8c4707e-ff3b-40ac-a87f-7261d14872b1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:10.624372 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b8c4707e-ff3b-40ac-a87f-7261d14872b1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:10.625103 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b8c4707e-ff3b-40ac-a87f-7261d14872b1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:10.626080 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b8c4707e-ff3b-40ac-a87f-7261d14872b1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:10.626952 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b8c4707e-ff3b-40ac-a87f-7261d14872b1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:10.886721 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b8c4707e-ff3b-40ac-a87f-7261d14872b1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "POST /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7/action" status: 202 len: 0 microversion: 2.1 time: 0.273056 Dec 20 09:31:10.887469 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 196/433] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:31:10 2021] POST /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:31:10.895956 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a9f639fe-1b7b-4602-abe7-32d208a95924 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:10.896574 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a9f639fe-1b7b-4602-abe7-32d208a95924 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:10.905263 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a9f639fe-1b7b-4602-abe7-32d208a95924 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:10.905706 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a9f639fe-1b7b-4602-abe7-32d208a95924 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:10.906511 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a9f639fe-1b7b-4602-abe7-32d208a95924 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:10.906956 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a9f639fe-1b7b-4602-abe7-32d208a95924 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:11.062913 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-36285712-2d8f-429e-aec0-c495458c41be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:11.064008 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-36285712-2d8f-429e-aec0-c495458c41be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:11.080080 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-36285712-2d8f-429e-aec0-c495458c41be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:11.080645 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-36285712-2d8f-429e-aec0-c495458c41be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:11.081485 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-36285712-2d8f-429e-aec0-c495458c41be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:11.081934 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-36285712-2d8f-429e-aec0-c495458c41be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:11.148258 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a9f639fe-1b7b-4602-abe7-32d208a95924 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:11.156327 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a9f639fe-1b7b-4602-abe7-32d208a95924 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1509 microversion: 2.1 time: 0.264392 Dec 20 09:31:11.160662 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 238/434] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:10 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1509 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:11.174518 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-36285712-2d8f-429e-aec0-c495458c41be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.116221 Dec 20 09:31:11.179481 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 197/435] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:11 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:31:11.346276 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-180e1fb6-358a-4b96-b3dd-5669f8a78869 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:11.346803 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-180e1fb6-358a-4b96-b3dd-5669f8a78869 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:11.352784 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-180e1fb6-358a-4b96-b3dd-5669f8a78869 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:11.353234 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-180e1fb6-358a-4b96-b3dd-5669f8a78869 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:11.354245 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-180e1fb6-358a-4b96-b3dd-5669f8a78869 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:11.355456 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-180e1fb6-358a-4b96-b3dd-5669f8a78869 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:11.518377 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-180e1fb6-358a-4b96-b3dd-5669f8a78869 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:11.526939 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-180e1fb6-358a-4b96-b3dd-5669f8a78869 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.183840 Dec 20 09:31:11.528161 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 239/436] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:11 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:12.178830 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b6a598b6-1000-4a62-a390-b760c2710750 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:12.179602 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b6a598b6-1000-4a62-a390-b760c2710750 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:12.187038 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-cd34617d-183d-4399-8b0f-9abb99f87be0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:12.188934 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-cd34617d-183d-4399-8b0f-9abb99f87be0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:12.197377 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b6a598b6-1000-4a62-a390-b760c2710750 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:12.197829 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b6a598b6-1000-4a62-a390-b760c2710750 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:12.201366 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b6a598b6-1000-4a62-a390-b760c2710750 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:12.201818 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b6a598b6-1000-4a62-a390-b760c2710750 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:12.202572 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cd34617d-183d-4399-8b0f-9abb99f87be0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:12.203025 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cd34617d-183d-4399-8b0f-9abb99f87be0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:12.203915 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cd34617d-183d-4399-8b0f-9abb99f87be0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:12.204357 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cd34617d-183d-4399-8b0f-9abb99f87be0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:12.360616 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b6a598b6-1000-4a62-a390-b760c2710750 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:12.367918 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b6a598b6-1000-4a62-a390-b760c2710750 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1509 microversion: 2.1 time: 0.193342 Dec 20 09:31:12.368479 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 198/437] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:12 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1509 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:12.544228 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a646036d-a3e4-4a12-9cbf-47782bec70d1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:12.544938 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a646036d-a3e4-4a12-9cbf-47782bec70d1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:12.551625 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a646036d-a3e4-4a12-9cbf-47782bec70d1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:12.552047 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a646036d-a3e4-4a12-9cbf-47782bec70d1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:12.552834 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a646036d-a3e4-4a12-9cbf-47782bec70d1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:12.553269 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a646036d-a3e4-4a12-9cbf-47782bec70d1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:12.695504 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a646036d-a3e4-4a12-9cbf-47782bec70d1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:12.703529 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a646036d-a3e4-4a12-9cbf-47782bec70d1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.163431 Dec 20 09:31:12.707348 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 199/438] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:12 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:13.385531 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-5b3547ee-45c9-40cf-94e8-8ffeeee8e6d7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:13.387466 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-5b3547ee-45c9-40cf-94e8-8ffeeee8e6d7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:13.393843 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5b3547ee-45c9-40cf-94e8-8ffeeee8e6d7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:13.394531 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5b3547ee-45c9-40cf-94e8-8ffeeee8e6d7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:13.395322 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5b3547ee-45c9-40cf-94e8-8ffeeee8e6d7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:13.395791 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5b3547ee-45c9-40cf-94e8-8ffeeee8e6d7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:13.536608 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-5b3547ee-45c9-40cf-94e8-8ffeeee8e6d7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:13.544571 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-5b3547ee-45c9-40cf-94e8-8ffeeee8e6d7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1509 microversion: 2.1 time: 0.162680 Dec 20 09:31:13.545448 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 200/439] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:13 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:13.720703 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-670b38e5-22d9-44e3-b2ef-0d098c6ea173 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:13.721821 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-670b38e5-22d9-44e3-b2ef-0d098c6ea173 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:13.728344 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-670b38e5-22d9-44e3-b2ef-0d098c6ea173 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:13.729079 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-670b38e5-22d9-44e3-b2ef-0d098c6ea173 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:13.730126 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-670b38e5-22d9-44e3-b2ef-0d098c6ea173 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:13.730569 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-670b38e5-22d9-44e3-b2ef-0d098c6ea173 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:13.868711 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-670b38e5-22d9-44e3-b2ef-0d098c6ea173 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:13.877137 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-670b38e5-22d9-44e3-b2ef-0d098c6ea173 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.160414 Dec 20 09:31:13.877790 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 201/440] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:13 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:14.562213 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-18a700d1-dd9b-4931-a208-4fd84c8a8b2e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:14.563636 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-18a700d1-dd9b-4931-a208-4fd84c8a8b2e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:14.570280 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-18a700d1-dd9b-4931-a208-4fd84c8a8b2e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:14.570734 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-18a700d1-dd9b-4931-a208-4fd84c8a8b2e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:14.571554 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-18a700d1-dd9b-4931-a208-4fd84c8a8b2e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:14.572162 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-18a700d1-dd9b-4931-a208-4fd84c8a8b2e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:14.716279 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-18a700d1-dd9b-4931-a208-4fd84c8a8b2e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:14.725999 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-18a700d1-dd9b-4931-a208-4fd84c8a8b2e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1509 microversion: 2.1 time: 0.167251 Dec 20 09:31:14.727453 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 202/441] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:14 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:14.894142 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d5bf5adb-81a7-4b69-8ee0-cdb80e56b7ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:14.895392 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d5bf5adb-81a7-4b69-8ee0-cdb80e56b7ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:14.901826 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d5bf5adb-81a7-4b69-8ee0-cdb80e56b7ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:14.902705 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d5bf5adb-81a7-4b69-8ee0-cdb80e56b7ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:14.903562 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d5bf5adb-81a7-4b69-8ee0-cdb80e56b7ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:14.904106 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d5bf5adb-81a7-4b69-8ee0-cdb80e56b7ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:15.053667 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d5bf5adb-81a7-4b69-8ee0-cdb80e56b7ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:15.062736 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d5bf5adb-81a7-4b69-8ee0-cdb80e56b7ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.172097 Dec 20 09:31:15.063700 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 203/442] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:14 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:15.746261 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8505713d-5b43-4b41-9e8b-cbbc12d72637 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:15.746261 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8505713d-5b43-4b41-9e8b-cbbc12d72637 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:15.753491 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8505713d-5b43-4b41-9e8b-cbbc12d72637 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:15.753942 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8505713d-5b43-4b41-9e8b-cbbc12d72637 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:15.754730 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8505713d-5b43-4b41-9e8b-cbbc12d72637 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:15.755164 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8505713d-5b43-4b41-9e8b-cbbc12d72637 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:15.912943 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8505713d-5b43-4b41-9e8b-cbbc12d72637 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:15.921350 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8505713d-5b43-4b41-9e8b-cbbc12d72637 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1509 microversion: 2.1 time: 0.181315 Dec 20 09:31:15.929401 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 204/443] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:15 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:16.081773 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-64431dce-58fb-4d6c-abda-09624effc679 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:16.082481 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-64431dce-58fb-4d6c-abda-09624effc679 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:16.089063 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-64431dce-58fb-4d6c-abda-09624effc679 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:16.089623 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-64431dce-58fb-4d6c-abda-09624effc679 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:16.090501 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-64431dce-58fb-4d6c-abda-09624effc679 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:16.091277 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-64431dce-58fb-4d6c-abda-09624effc679 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:16.255529 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-64431dce-58fb-4d6c-abda-09624effc679 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:16.263206 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-64431dce-58fb-4d6c-abda-09624effc679 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.186776 Dec 20 09:31:16.272402 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 205/444] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:16 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:16.938220 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-001a1e3c-9d8e-4b9e-8e53-330f1aa3170f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:16.939545 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-001a1e3c-9d8e-4b9e-8e53-330f1aa3170f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:16.949118 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-001a1e3c-9d8e-4b9e-8e53-330f1aa3170f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:16.949566 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-001a1e3c-9d8e-4b9e-8e53-330f1aa3170f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:16.950351 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-001a1e3c-9d8e-4b9e-8e53-330f1aa3170f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:16.950779 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-001a1e3c-9d8e-4b9e-8e53-330f1aa3170f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:17.118943 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-001a1e3c-9d8e-4b9e-8e53-330f1aa3170f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:17.127055 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-001a1e3c-9d8e-4b9e-8e53-330f1aa3170f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1509 microversion: 2.1 time: 0.192365 Dec 20 09:31:17.127611 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 206/445] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:16 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1509 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:17.280049 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-facc22d7-a36d-4033-879c-9461229c930c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:17.284897 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-facc22d7-a36d-4033-879c-9461229c930c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:17.286878 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-facc22d7-a36d-4033-879c-9461229c930c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:17.287395 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-facc22d7-a36d-4033-879c-9461229c930c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:17.288430 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-facc22d7-a36d-4033-879c-9461229c930c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:17.288943 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-facc22d7-a36d-4033-879c-9461229c930c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:17.453435 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-facc22d7-a36d-4033-879c-9461229c930c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:17.461028 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-facc22d7-a36d-4033-879c-9461229c930c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.185630 Dec 20 09:31:17.470398 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 207/446] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:17 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:18.144324 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e0574518-bbfd-4811-962f-a37b39551314 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:18.145079 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e0574518-bbfd-4811-962f-a37b39551314 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:18.151804 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e0574518-bbfd-4811-962f-a37b39551314 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:18.152250 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e0574518-bbfd-4811-962f-a37b39551314 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:18.153063 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e0574518-bbfd-4811-962f-a37b39551314 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:18.153459 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e0574518-bbfd-4811-962f-a37b39551314 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:18.338975 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e0574518-bbfd-4811-962f-a37b39551314 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:18.346303 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e0574518-bbfd-4811-962f-a37b39551314 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1509 microversion: 2.1 time: 0.205632 Dec 20 09:31:18.346872 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 208/447] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:18 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:18.478262 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b22fb392-6f7c-4350-a761-a576b67baca4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:18.478262 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b22fb392-6f7c-4350-a761-a576b67baca4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:18.485022 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b22fb392-6f7c-4350-a761-a576b67baca4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:18.485476 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b22fb392-6f7c-4350-a761-a576b67baca4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:18.486262 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b22fb392-6f7c-4350-a761-a576b67baca4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:18.486698 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b22fb392-6f7c-4350-a761-a576b67baca4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:18.616524 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b22fb392-6f7c-4350-a761-a576b67baca4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:18.624283 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b22fb392-6f7c-4350-a761-a576b67baca4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.150510 Dec 20 09:31:18.624918 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 209/448] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:18 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:19.363066 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a43d8d11-9bcc-4ea3-a46b-483561b31b4c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:19.363702 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a43d8d11-9bcc-4ea3-a46b-483561b31b4c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:19.369784 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a43d8d11-9bcc-4ea3-a46b-483561b31b4c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:19.370238 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a43d8d11-9bcc-4ea3-a46b-483561b31b4c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:19.371003 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a43d8d11-9bcc-4ea3-a46b-483561b31b4c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:19.371435 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a43d8d11-9bcc-4ea3-a46b-483561b31b4c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:19.499773 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a43d8d11-9bcc-4ea3-a46b-483561b31b4c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:19.507385 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a43d8d11-9bcc-4ea3-a46b-483561b31b4c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1509 microversion: 2.1 time: 0.147952 Dec 20 09:31:19.507983 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 210/449] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:19 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:19.641408 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a2a9d1a4-9432-423d-8b7d-ab177347a1f9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:19.642019 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a2a9d1a4-9432-423d-8b7d-ab177347a1f9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:19.647964 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a2a9d1a4-9432-423d-8b7d-ab177347a1f9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:19.648413 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a2a9d1a4-9432-423d-8b7d-ab177347a1f9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:19.649184 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a2a9d1a4-9432-423d-8b7d-ab177347a1f9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:19.649618 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a2a9d1a4-9432-423d-8b7d-ab177347a1f9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:19.778333 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a2a9d1a4-9432-423d-8b7d-ab177347a1f9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:19.785534 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a2a9d1a4-9432-423d-8b7d-ab177347a1f9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.147842 Dec 20 09:31:19.786094 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 211/450] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:19 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:20.524571 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0178691d-2371-4d23-91f8-bd9e492e38aa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:20.525142 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0178691d-2371-4d23-91f8-bd9e492e38aa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:20.531738 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0178691d-2371-4d23-91f8-bd9e492e38aa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:20.532180 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0178691d-2371-4d23-91f8-bd9e492e38aa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:20.532940 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0178691d-2371-4d23-91f8-bd9e492e38aa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:20.533366 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0178691d-2371-4d23-91f8-bd9e492e38aa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:20.660813 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-0178691d-2371-4d23-91f8-bd9e492e38aa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:20.668099 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0178691d-2371-4d23-91f8-bd9e492e38aa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1509 microversion: 2.1 time: 0.147248 Dec 20 09:31:20.668800 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 212/451] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:20 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:20.801690 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d4dd8810-1ea1-4017-8c1c-7e2af5399cb0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:20.802237 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d4dd8810-1ea1-4017-8c1c-7e2af5399cb0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:20.807951 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d4dd8810-1ea1-4017-8c1c-7e2af5399cb0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:20.808400 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d4dd8810-1ea1-4017-8c1c-7e2af5399cb0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:20.811428 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d4dd8810-1ea1-4017-8c1c-7e2af5399cb0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:20.811428 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d4dd8810-1ea1-4017-8c1c-7e2af5399cb0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:20.938737 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d4dd8810-1ea1-4017-8c1c-7e2af5399cb0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:20.946107 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d4dd8810-1ea1-4017-8c1c-7e2af5399cb0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.148148 Dec 20 09:31:20.946687 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 213/452] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:20 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:21.239276 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-cd34617d-183d-4399-8b0f-9abb99f87be0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 9.056304 Dec 20 09:31:21.240387 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 240/453] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:12 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 9058 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:31:21.685397 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d56b81e7-fdbf-4440-87f2-83b060d434a8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:21.686688 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d56b81e7-fdbf-4440-87f2-83b060d434a8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:21.693378 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d56b81e7-fdbf-4440-87f2-83b060d434a8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:21.694085 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d56b81e7-fdbf-4440-87f2-83b060d434a8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:21.695126 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d56b81e7-fdbf-4440-87f2-83b060d434a8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:21.695599 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d56b81e7-fdbf-4440-87f2-83b060d434a8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:21.877528 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d56b81e7-fdbf-4440-87f2-83b060d434a8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:21.885084 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d56b81e7-fdbf-4440-87f2-83b060d434a8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1509 microversion: 2.1 time: 0.203843 Dec 20 09:31:21.894241 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 214/454] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:21 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:21.962934 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f241c66e-8dd3-4f4d-9b15-f2eb3c26d6db tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:21.968688 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f241c66e-8dd3-4f4d-9b15-f2eb3c26d6db tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:21.972361 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f241c66e-8dd3-4f4d-9b15-f2eb3c26d6db tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:21.972808 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f241c66e-8dd3-4f4d-9b15-f2eb3c26d6db tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:21.973774 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f241c66e-8dd3-4f4d-9b15-f2eb3c26d6db tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:21.974211 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f241c66e-8dd3-4f4d-9b15-f2eb3c26d6db tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:22.137961 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f241c66e-8dd3-4f4d-9b15-f2eb3c26d6db tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:22.145450 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f241c66e-8dd3-4f4d-9b15-f2eb3c26d6db tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.186824 Dec 20 09:31:22.146012 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 241/455] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:21 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:22.251007 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-32260dfd-258c-4e73-b40f-e3e2d6e40780 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:22.252226 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-32260dfd-258c-4e73-b40f-e3e2d6e40780 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:22.258090 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-32260dfd-258c-4e73-b40f-e3e2d6e40780 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:22.258534 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-32260dfd-258c-4e73-b40f-e3e2d6e40780 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:22.259371 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-32260dfd-258c-4e73-b40f-e3e2d6e40780 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:22.259829 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-32260dfd-258c-4e73-b40f-e3e2d6e40780 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:22.557428 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-32260dfd-258c-4e73-b40f-e3e2d6e40780 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.309949 Dec 20 09:31:22.558067 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 215/456] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:22 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:31:22.902198 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b9ac5751-aabb-45c3-823c-a3bac9a291e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:22.903155 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b9ac5751-aabb-45c3-823c-a3bac9a291e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:22.909509 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b9ac5751-aabb-45c3-823c-a3bac9a291e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:22.909963 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b9ac5751-aabb-45c3-823c-a3bac9a291e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:22.910763 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b9ac5751-aabb-45c3-823c-a3bac9a291e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:22.911204 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b9ac5751-aabb-45c3-823c-a3bac9a291e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:23.038759 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b9ac5751-aabb-45c3-823c-a3bac9a291e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:23.046121 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b9ac5751-aabb-45c3-823c-a3bac9a291e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1509 microversion: 2.1 time: 0.148419 Dec 20 09:31:23.046687 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 242/457] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:22 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:23.162435 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-952511c1-4178-4e2e-b7a8-6efa74e06eef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:23.163055 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-952511c1-4178-4e2e-b7a8-6efa74e06eef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:23.169884 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-952511c1-4178-4e2e-b7a8-6efa74e06eef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:23.170320 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-952511c1-4178-4e2e-b7a8-6efa74e06eef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:23.171081 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-952511c1-4178-4e2e-b7a8-6efa74e06eef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:23.171508 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-952511c1-4178-4e2e-b7a8-6efa74e06eef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:23.297265 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-952511c1-4178-4e2e-b7a8-6efa74e06eef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:23.304619 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-952511c1-4178-4e2e-b7a8-6efa74e06eef tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.146192 Dec 20 09:31:23.305183 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 216/458] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:23 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:23.569437 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c167ee57-157b-4baa-9bf9-858d72abc4f3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:23.570265 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c167ee57-157b-4baa-9bf9-858d72abc4f3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:23.577187 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c167ee57-157b-4baa-9bf9-858d72abc4f3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:23.577684 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c167ee57-157b-4baa-9bf9-858d72abc4f3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:23.578529 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c167ee57-157b-4baa-9bf9-858d72abc4f3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:23.578978 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c167ee57-157b-4baa-9bf9-858d72abc4f3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:24.062572 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1bfd6586-0169-4b80-86b2-f83986749796 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:24.063197 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1bfd6586-0169-4b80-86b2-f83986749796 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:24.069529 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1bfd6586-0169-4b80-86b2-f83986749796 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:24.069978 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1bfd6586-0169-4b80-86b2-f83986749796 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:24.070754 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1bfd6586-0169-4b80-86b2-f83986749796 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:24.071191 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1bfd6586-0169-4b80-86b2-f83986749796 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:24.205125 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1bfd6586-0169-4b80-86b2-f83986749796 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:24.215586 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1bfd6586-0169-4b80-86b2-f83986749796 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1509 microversion: 2.1 time: 0.153530 Dec 20 09:31:24.215586 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 217/459] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:24 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:24.321167 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-3fd180f5-8110-431f-96bd-b9d42ab36a2f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:24.325727 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-3fd180f5-8110-431f-96bd-b9d42ab36a2f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:24.328765 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3fd180f5-8110-431f-96bd-b9d42ab36a2f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:24.329205 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3fd180f5-8110-431f-96bd-b9d42ab36a2f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:24.329966 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3fd180f5-8110-431f-96bd-b9d42ab36a2f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:24.330396 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3fd180f5-8110-431f-96bd-b9d42ab36a2f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:24.469799 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-3fd180f5-8110-431f-96bd-b9d42ab36a2f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:24.477249 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-3fd180f5-8110-431f-96bd-b9d42ab36a2f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.159707 Dec 20 09:31:24.477818 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 218/460] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:24 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:24.559095 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c167ee57-157b-4baa-9bf9-858d72abc4f3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.993456 Dec 20 09:31:24.559802 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 243/461] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:23 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:31:25.229388 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-18a0eb1e-1db3-48d0-a314-74c29e52cfa7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:25.230148 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-18a0eb1e-1db3-48d0-a314-74c29e52cfa7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:25.236441 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-18a0eb1e-1db3-48d0-a314-74c29e52cfa7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:25.236887 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-18a0eb1e-1db3-48d0-a314-74c29e52cfa7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:25.237665 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-18a0eb1e-1db3-48d0-a314-74c29e52cfa7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:25.238099 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-18a0eb1e-1db3-48d0-a314-74c29e52cfa7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:25.378307 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-18a0eb1e-1db3-48d0-a314-74c29e52cfa7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:25.383724 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-18a0eb1e-1db3-48d0-a314-74c29e52cfa7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1509 microversion: 2.1 time: 0.158080 Dec 20 09:31:25.384298 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 219/462] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:25 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:25.494420 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ee0826d3-3946-4fe9-9a27-61c38f4d96fd tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:25.495112 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ee0826d3-3946-4fe9-9a27-61c38f4d96fd tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:25.502188 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ee0826d3-3946-4fe9-9a27-61c38f4d96fd tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:25.502632 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ee0826d3-3946-4fe9-9a27-61c38f4d96fd tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:25.503412 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ee0826d3-3946-4fe9-9a27-61c38f4d96fd tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:25.503872 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ee0826d3-3946-4fe9-9a27-61c38f4d96fd tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:25.570424 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0ac7c0f9-609b-42fb-8c56-ed8651cb18c5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:25.571616 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0ac7c0f9-609b-42fb-8c56-ed8651cb18c5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:25.578450 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0ac7c0f9-609b-42fb-8c56-ed8651cb18c5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:25.578993 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0ac7c0f9-609b-42fb-8c56-ed8651cb18c5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:25.579811 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0ac7c0f9-609b-42fb-8c56-ed8651cb18c5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:25.580254 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0ac7c0f9-609b-42fb-8c56-ed8651cb18c5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:25.639556 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ee0826d3-3946-4fe9-9a27-61c38f4d96fd tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:25.647316 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ee0826d3-3946-4fe9-9a27-61c38f4d96fd tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.156857 Dec 20 09:31:25.647911 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 244/463] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:25 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:25.718053 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-5de94388-d146-4f33-b43e-29993d424d46 req-d6468d80-c79d-4a65-b58d-1c68345479cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ad12943-79b4-4049-98a9-0a88b6cb199d", "name": "network-vif-plugged", "status": "completed", "tag": "91f40bfa-c185-4389-a36a-95ea7e7071de"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:25.719602 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:31:25.719602 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:31:25.726430 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-5de94388-d146-4f33-b43e-29993d424d46 req-d6468d80-c79d-4a65-b58d-1c68345479cf service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:25.726868 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-5de94388-d146-4f33-b43e-29993d424d46 req-d6468d80-c79d-4a65-b58d-1c68345479cf service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:25.737430 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-5de94388-d146-4f33-b43e-29993d424d46 req-d6468d80-c79d-4a65-b58d-1c68345479cf service nova] Creating event network-vif-plugged:91f40bfa-c185-4389-a36a-95ea7e7071de for instance 4ad12943-79b4-4049-98a9-0a88b6cb199d on hv-cinder-81908 Dec 20 09:31:25.742121 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-5de94388-d146-4f33-b43e-29993d424d46 req-d6468d80-c79d-4a65-b58d-1c68345479cf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027796 Dec 20 09:31:25.742688 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 245/464] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:31:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:31:25.966901 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0ac7c0f9-609b-42fb-8c56-ed8651cb18c5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28156 microversion: 2.20 time: 0.400039 Dec 20 09:31:25.967625 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 220/465] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:25 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28156 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:31:26.402070 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-84883996-9645-4474-8430-f374e6363012 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:26.402888 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-84883996-9645-4474-8430-f374e6363012 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:26.409083 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84883996-9645-4474-8430-f374e6363012 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:26.409623 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84883996-9645-4474-8430-f374e6363012 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:26.410586 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84883996-9645-4474-8430-f374e6363012 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:26.411018 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84883996-9645-4474-8430-f374e6363012 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:26.545013 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-84883996-9645-4474-8430-f374e6363012 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:26.552420 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-84883996-9645-4474-8430-f374e6363012 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1509 microversion: 2.1 time: 0.155298 Dec 20 09:31:26.552981 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 246/466] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:26 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:26.665091 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e9414d94-cb37-49e5-89ec-dccb513abc04 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:26.665906 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e9414d94-cb37-49e5-89ec-dccb513abc04 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:26.673138 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e9414d94-cb37-49e5-89ec-dccb513abc04 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:26.680812 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e9414d94-cb37-49e5-89ec-dccb513abc04 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:26.680812 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e9414d94-cb37-49e5-89ec-dccb513abc04 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:26.680812 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e9414d94-cb37-49e5-89ec-dccb513abc04 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:26.814389 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e9414d94-cb37-49e5-89ec-dccb513abc04 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:26.821819 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e9414d94-cb37-49e5-89ec-dccb513abc04 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.160957 Dec 20 09:31:26.822462 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 221/467] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:26 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:26.978383 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-102b3289-5a36-4db2-8e51-66c8579c5d35 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:26.979900 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-102b3289-5a36-4db2-8e51-66c8579c5d35 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:26.986260 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-102b3289-5a36-4db2-8e51-66c8579c5d35 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:26.986700 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-102b3289-5a36-4db2-8e51-66c8579c5d35 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:26.987471 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-102b3289-5a36-4db2-8e51-66c8579c5d35 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:26.987933 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-102b3289-5a36-4db2-8e51-66c8579c5d35 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:27.246420 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-102b3289-5a36-4db2-8e51-66c8579c5d35 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28447 microversion: 2.20 time: 0.271623 Dec 20 09:31:27.247083 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 247/468] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:26 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28447 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:31:27.569007 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0386499a-41a2-4908-b085-de2fc2fcacf6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:27.569555 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0386499a-41a2-4908-b085-de2fc2fcacf6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:27.576360 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0386499a-41a2-4908-b085-de2fc2fcacf6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:27.576813 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0386499a-41a2-4908-b085-de2fc2fcacf6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:27.577583 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0386499a-41a2-4908-b085-de2fc2fcacf6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:27.578018 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0386499a-41a2-4908-b085-de2fc2fcacf6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:27.709247 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-0386499a-41a2-4908-b085-de2fc2fcacf6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:27.720845 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0386499a-41a2-4908-b085-de2fc2fcacf6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1509 microversion: 2.1 time: 0.155563 Dec 20 09:31:27.722111 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 222/469] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:27 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:27.838673 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a0c203cd-dc85-46f1-8262-7b30d11a387f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:27.839367 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a0c203cd-dc85-46f1-8262-7b30d11a387f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:27.846197 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a0c203cd-dc85-46f1-8262-7b30d11a387f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:27.846653 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a0c203cd-dc85-46f1-8262-7b30d11a387f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:27.847435 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a0c203cd-dc85-46f1-8262-7b30d11a387f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:27.847906 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a0c203cd-dc85-46f1-8262-7b30d11a387f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:27.981800 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a0c203cd-dc85-46f1-8262-7b30d11a387f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:27.989340 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a0c203cd-dc85-46f1-8262-7b30d11a387f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.154628 Dec 20 09:31:27.989908 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 248/470] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:27 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:28.258378 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c9969139-c40b-4ce7-8214-524842697a3d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:28.259303 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c9969139-c40b-4ce7-8214-524842697a3d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:28.266096 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9969139-c40b-4ce7-8214-524842697a3d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:28.266549 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9969139-c40b-4ce7-8214-524842697a3d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:28.267336 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9969139-c40b-4ce7-8214-524842697a3d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:28.267803 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9969139-c40b-4ce7-8214-524842697a3d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:28.501426 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c9969139-c40b-4ce7-8214-524842697a3d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28447 microversion: 2.20 time: 0.246385 Dec 20 09:31:28.507234 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 223/471] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:28 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28447 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:31:28.738229 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-373046d3-f35c-460b-b9a7-243e03c0b9e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:28.738844 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-373046d3-f35c-460b-b9a7-243e03c0b9e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:28.745571 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-373046d3-f35c-460b-b9a7-243e03c0b9e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:28.746011 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-373046d3-f35c-460b-b9a7-243e03c0b9e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:28.746802 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-373046d3-f35c-460b-b9a7-243e03c0b9e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:28.747246 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-373046d3-f35c-460b-b9a7-243e03c0b9e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:28.925048 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-373046d3-f35c-460b-b9a7-243e03c0b9e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:28.934512 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-373046d3-f35c-460b-b9a7-243e03c0b9e3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1509 microversion: 2.1 time: 0.199537 Dec 20 09:31:28.935263 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 249/472] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:28 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1509 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:29.006704 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-180fb065-636f-40e4-ab9e-849361afd44f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:29.008348 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-180fb065-636f-40e4-ab9e-849361afd44f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:29.015864 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-180fb065-636f-40e4-ab9e-849361afd44f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:29.016398 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-180fb065-636f-40e4-ab9e-849361afd44f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:29.017250 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-180fb065-636f-40e4-ab9e-849361afd44f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:29.017759 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-180fb065-636f-40e4-ab9e-849361afd44f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:29.250204 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-180fb065-636f-40e4-ab9e-849361afd44f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:29.258574 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-180fb065-636f-40e4-ab9e-849361afd44f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1317 microversion: 2.1 time: 0.255598 Dec 20 09:31:29.263852 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 224/473] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:29 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:29.513907 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-6d8cfc69-54c3-495d-8c56-c1299233856d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:29.515032 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-6d8cfc69-54c3-495d-8c56-c1299233856d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:29.529057 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6d8cfc69-54c3-495d-8c56-c1299233856d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:29.529511 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6d8cfc69-54c3-495d-8c56-c1299233856d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:29.530307 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6d8cfc69-54c3-495d-8c56-c1299233856d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:29.530923 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6d8cfc69-54c3-495d-8c56-c1299233856d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:29.629159 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-6d8cfc69-54c3-495d-8c56-c1299233856d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28447 microversion: 2.20 time: 0.118842 Dec 20 09:31:29.633214 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 250/474] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:29 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28447 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:31:29.954657 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9711c65c-34da-42fd-862e-e3a76ca7ff1c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:29.955300 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9711c65c-34da-42fd-862e-e3a76ca7ff1c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:29.961520 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9711c65c-34da-42fd-862e-e3a76ca7ff1c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:29.961963 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9711c65c-34da-42fd-862e-e3a76ca7ff1c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:29.962742 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9711c65c-34da-42fd-862e-e3a76ca7ff1c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:29.963178 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9711c65c-34da-42fd-862e-e3a76ca7ff1c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:30.274705 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b2be6cd4-718c-44c8-aec6-ab88b93777ee tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:30.275622 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b2be6cd4-718c-44c8-aec6-ab88b93777ee tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:30.284719 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b2be6cd4-718c-44c8-aec6-ab88b93777ee tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:30.285480 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b2be6cd4-718c-44c8-aec6-ab88b93777ee tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:30.286555 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b2be6cd4-718c-44c8-aec6-ab88b93777ee tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:30.287224 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b2be6cd4-718c-44c8-aec6-ab88b93777ee tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:30.327785 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-9711c65c-34da-42fd-862e-e3a76ca7ff1c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:30.335479 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9711c65c-34da-42fd-862e-e3a76ca7ff1c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1515 microversion: 2.1 time: 0.384418 Dec 20 09:31:30.342111 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 225/475] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:29 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1515 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:30.432223 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b2be6cd4-718c-44c8-aec6-ab88b93777ee tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:30.442990 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b2be6cd4-718c-44c8-aec6-ab88b93777ee tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1507 microversion: 2.1 time: 0.172221 Dec 20 09:31:30.443685 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 251/476] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:30 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:30.460059 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-aece65fe-9281-489c-a34f-6483e2c3047d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e65e575-ec37-4e40-a4e4-e6c97b70479c"}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:30.461119 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-aece65fe-9281-489c-a34f-6483e2c3047d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:30.467492 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-aece65fe-9281-489c-a34f-6483e2c3047d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:30.467970 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-aece65fe-9281-489c-a34f-6483e2c3047d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:30.468761 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-aece65fe-9281-489c-a34f-6483e2c3047d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:30.469270 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-aece65fe-9281-489c-a34f-6483e2c3047d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:30.650742 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-25d9ac09-5725-4e1f-986f-83cf785e68ba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:30.650742 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-25d9ac09-5725-4e1f-986f-83cf785e68ba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:30.650742 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-25d9ac09-5725-4e1f-986f-83cf785e68ba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:30.650742 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-25d9ac09-5725-4e1f-986f-83cf785e68ba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:30.651433 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-25d9ac09-5725-4e1f-986f-83cf785e68ba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:30.651433 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-25d9ac09-5725-4e1f-986f-83cf785e68ba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:30.749258 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-25d9ac09-5725-4e1f-986f-83cf785e68ba tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28613 microversion: 2.20 time: 0.112034 Dec 20 09:31:30.750193 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 252/477] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:30 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28613 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:31:31.009236 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-aece65fe-9281-489c-a34f-6483e2c3047d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] HTTP exception thrown: Invalid volume: volume 7e65e575-ec37-4e40-a4e4-e6c97b70479c is already attached to instances: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 Dec 20 09:31:31.009832 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-aece65fe-9281-489c-a34f-6483e2c3047d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Returning 400 to user: Invalid volume: volume 7e65e575-ec37-4e40-a4e4-e6c97b70479c is already attached to instances: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:31:31.010729 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-aece65fe-9281-489c-a34f-6483e2c3047d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "POST /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.554448 Dec 20 09:31:31.011295 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 226/478] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 20 09:31:30 2021] POST /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d/os-volume_attachments => generated 174 bytes in 556 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 20 09:31:31.102458 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-dd4c22a0-c035-4ce9-aa4c-8db8be6fc6b7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:31.103039 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-dd4c22a0-c035-4ce9-aa4c-8db8be6fc6b7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:31.109955 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dd4c22a0-c035-4ce9-aa4c-8db8be6fc6b7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:31.110404 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dd4c22a0-c035-4ce9-aa4c-8db8be6fc6b7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:31.111185 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dd4c22a0-c035-4ce9-aa4c-8db8be6fc6b7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:31.111621 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dd4c22a0-c035-4ce9-aa4c-8db8be6fc6b7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:31.239287 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.objects.instance [None req-dd4c22a0-c035-4ce9-aa4c-8db8be6fc6b7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lazy-loading 'services' on Instance uuid 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 {{(pid=116674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:31:31.546630 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-dd4c22a0-c035-4ce9-aa4c-8db8be6fc6b7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8/os-volume_attachments/7e65e575-ec37-4e40-a4e4-e6c97b70479c" status: 202 len: 0 microversion: 2.1 time: 0.448095 Dec 20 09:31:31.547537 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 253/479] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 20 09:31:31 2021] DELETE /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8/os-volume_attachments/7e65e575-ec37-4e40-a4e4-e6c97b70479c => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:31:31.555702 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2ca852e3-b388-4465-a24a-78251e7a3187 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:31.556681 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2ca852e3-b388-4465-a24a-78251e7a3187 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:31.566241 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2ca852e3-b388-4465-a24a-78251e7a3187 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:31.566829 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2ca852e3-b388-4465-a24a-78251e7a3187 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:31.567622 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2ca852e3-b388-4465-a24a-78251e7a3187 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:31.568088 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2ca852e3-b388-4465-a24a-78251e7a3187 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:31.597834 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2ca852e3-b388-4465-a24a-78251e7a3187 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045847 Dec 20 09:31:31.598394 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 227/480] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:31:31 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:31:31.763225 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e5b13759-76c0-409a-97f9-e87d9b208c17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:31.764429 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e5b13759-76c0-409a-97f9-e87d9b208c17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:31.771044 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e5b13759-76c0-409a-97f9-e87d9b208c17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:31.771556 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e5b13759-76c0-409a-97f9-e87d9b208c17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:31.772660 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e5b13759-76c0-409a-97f9-e87d9b208c17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:31.773244 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e5b13759-76c0-409a-97f9-e87d9b208c17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:31.858843 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e5b13759-76c0-409a-97f9-e87d9b208c17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.100147 Dec 20 09:31:31.859514 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 254/481] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:31 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:31:32.224161 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a0f56d7c-0234-4833-b8b0-031cc367e3a2 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-210023662", "imageRef": "6f828f0b-c445-46a5-9960-492746785ef3", "flavorRef": "452", "networks": [{"uuid": "d5650661-8868-4cf3-8c19-4f747aad5df6"}]}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:32.279954 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.network.neutron [None req-a0f56d7c-0234-4833-b8b0-031cc367e3a2 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] validate_networks() for [('d5650661-8868-4cf3-8c19-4f747aad5df6', None, None, None, None, None)] {{(pid=116675) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 09:31:32.609667 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-323c18ab-dc98-4a72-9915-62c1e982feff tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:32.610770 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-323c18ab-dc98-4a72-9915-62c1e982feff tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:32.617706 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-323c18ab-dc98-4a72-9915-62c1e982feff tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:32.618220 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-323c18ab-dc98-4a72-9915-62c1e982feff tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:32.619060 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-323c18ab-dc98-4a72-9915-62c1e982feff tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:32.619559 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-323c18ab-dc98-4a72-9915-62c1e982feff tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:32.642849 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-a0f56d7c-0234-4833-b8b0-031cc367e3a2 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Flavor limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 09:31:32.643329 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-a0f56d7c-0234-4833-b8b0-031cc367e3a2 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Image limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 09:31:32.643771 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-a0f56d7c-0234-4833-b8b0-031cc367e3a2 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Flavor pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 09:31:32.644184 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-a0f56d7c-0234-4833-b8b0-031cc367e3a2 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Image pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 09:31:32.644693 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-a0f56d7c-0234-4833-b8b0-031cc367e3a2 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 09:31:32.654651 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-323c18ab-dc98-4a72-9915-62c1e982feff tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049181 Dec 20 09:31:32.654839 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a0f56d7c-0234-4833-b8b0-031cc367e3a2 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:32.655215 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 255/482] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:31:32 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:31:32.655325 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a0f56d7c-0234-4833-b8b0-031cc367e3a2 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:32.656201 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a0f56d7c-0234-4833-b8b0-031cc367e3a2 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:32.656701 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a0f56d7c-0234-4833-b8b0-031cc367e3a2 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:32.673383 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-a0f56d7c-0234-4833-b8b0-031cc367e3a2 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Getting quotas for project b148577d1c274f06aa51efc897f84e33. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:31:32.677236 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-a0f56d7c-0234-4833-b8b0-031cc367e3a2 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Getting quotas for user 36a8c4cf59e247bd8dfc5e285b20434d and project b148577d1c274f06aa51efc897f84e33. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:31:32.688385 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a0f56d7c-0234-4833-b8b0-031cc367e3a2 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Going to run 1 instances... {{(pid=116675) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 09:31:32.690666 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a0f56d7c-0234-4833-b8b0-031cc367e3a2 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f828f0b-c445-46a5-9960-492746785ef3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 09:31:32.843894 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a0f56d7c-0234-4833-b8b0-031cc367e3a2 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [4f13399f-34be-49c2-9ba2-00afa9d42b20] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 20 09:31:32.873182 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c28d1c2c-11fc-4b4c-9c55-8340898baf22 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:32.873182 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c28d1c2c-11fc-4b4c-9c55-8340898baf22 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:32.878657 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c28d1c2c-11fc-4b4c-9c55-8340898baf22 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:32.879127 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c28d1c2c-11fc-4b4c-9c55-8340898baf22 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:32.880504 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c28d1c2c-11fc-4b4c-9c55-8340898baf22 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:32.881273 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c28d1c2c-11fc-4b4c-9c55-8340898baf22 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:32.952934 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c28d1c2c-11fc-4b4c-9c55-8340898baf22 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.086012 Dec 20 09:31:32.953469 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 256/483] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:32 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:31:33.338528 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a955e185-48a7-4997-a634-46d3189a170f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:33.347743 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a955e185-48a7-4997-a634-46d3189a170f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:33.357753 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a955e185-48a7-4997-a634-46d3189a170f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:33.357753 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a955e185-48a7-4997-a634-46d3189a170f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:33.357753 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a955e185-48a7-4997-a634-46d3189a170f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:33.357753 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a955e185-48a7-4997-a634-46d3189a170f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:33.488099 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a955e185-48a7-4997-a634-46d3189a170f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:33.495552 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a955e185-48a7-4997-a634-46d3189a170f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1515 microversion: 2.1 time: 0.162076 Dec 20 09:31:33.496815 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 257/484] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:33 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:33.512127 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d363ed22-3d8f-4219-a8d5-f74b1d57392c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d41b8a8-fcf1-4e69-b3c7-bc50e0469f7c"}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:33.513188 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d363ed22-3d8f-4219-a8d5-f74b1d57392c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:33.518883 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d363ed22-3d8f-4219-a8d5-f74b1d57392c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:33.519436 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d363ed22-3d8f-4219-a8d5-f74b1d57392c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:33.520249 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d363ed22-3d8f-4219-a8d5-f74b1d57392c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:33.520683 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d363ed22-3d8f-4219-a8d5-f74b1d57392c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:33.851390 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO oslo.messaging._drivers.impl_rabbit [None req-a0f56d7c-0234-4833-b8b0-031cc367e3a2 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [4f13399f-34be-49c2-9ba2-00afa9d42b20] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 60704. Dec 20 09:31:33.856478 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a0f56d7c-0234-4833-b8b0-031cc367e3a2 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.638432 Dec 20 09:31:33.857112 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 228/485] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 20 09:31:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 1640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 09:31:33.861566 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ab130201-f548-44e8-8405-6ba1931d7b11 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:33.862699 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ab130201-f548-44e8-8405-6ba1931d7b11 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:33.869591 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ab130201-f548-44e8-8405-6ba1931d7b11 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:33.870041 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ab130201-f548-44e8-8405-6ba1931d7b11 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:33.872876 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ab130201-f548-44e8-8405-6ba1931d7b11 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:33.872876 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ab130201-f548-44e8-8405-6ba1931d7b11 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:33.910578 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ab130201-f548-44e8-8405-6ba1931d7b11 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051997 Dec 20 09:31:33.916281 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 229/486] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:31:33 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 09:31:33.917801 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9272f04d-133a-4d65-8a2a-c17c41908f8a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:33.918494 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9272f04d-133a-4d65-8a2a-c17c41908f8a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:34.007341 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-9272f04d-133a-4d65-8a2a-c17c41908f8a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:34.016385 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9272f04d-133a-4d65-8a2a-c17c41908f8a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1218 microversion: 2.1 time: 0.102987 Dec 20 09:31:34.016948 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 230/487] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:33 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:34.021499 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0225c99c-0959-41f3-84fd-32da3a89a7c3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:34.022840 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0225c99c-0959-41f3-84fd-32da3a89a7c3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:34.040357 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0225c99c-0959-41f3-84fd-32da3a89a7c3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:34.040917 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0225c99c-0959-41f3-84fd-32da3a89a7c3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:34.041777 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0225c99c-0959-41f3-84fd-32da3a89a7c3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:34.043684 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0225c99c-0959-41f3-84fd-32da3a89a7c3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:34.114599 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0225c99c-0959-41f3-84fd-32da3a89a7c3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.096324 Dec 20 09:31:34.115239 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 231/488] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:34 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:31:34.140579 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e0f4f507-8ec2-43a3-85c4-efc6c7fc5856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1316479615", "imageRef": "6f828f0b-c445-46a5-9960-492746785ef3", "flavorRef": "452", "networks": [{"uuid": "eda8d65d-a28a-4b39-afdf-98df1672c489"}]}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:34.194387 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.network.neutron [None req-e0f4f507-8ec2-43a3-85c4-efc6c7fc5856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] validate_networks() for [('eda8d65d-a28a-4b39-afdf-98df1672c489', None, None, None, None, None)] {{(pid=116675) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 09:31:34.377149 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d363ed22-3d8f-4219-a8d5-f74b1d57392c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "POST /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.868843 Dec 20 09:31:34.377938 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 258/489] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 20 09:31:33 2021] POST /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7/os-volume_attachments => generated 194 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:31:34.610738 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-e0f4f507-8ec2-43a3-85c4-efc6c7fc5856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Flavor limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 09:31:34.611160 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-e0f4f507-8ec2-43a3-85c4-efc6c7fc5856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Image limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 09:31:34.611705 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-e0f4f507-8ec2-43a3-85c4-efc6c7fc5856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Flavor pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 09:31:34.612205 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-e0f4f507-8ec2-43a3-85c4-efc6c7fc5856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Image pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 09:31:34.613476 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-e0f4f507-8ec2-43a3-85c4-efc6c7fc5856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 09:31:34.623139 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e0f4f507-8ec2-43a3-85c4-efc6c7fc5856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:34.623628 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e0f4f507-8ec2-43a3-85c4-efc6c7fc5856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:34.624704 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e0f4f507-8ec2-43a3-85c4-efc6c7fc5856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:34.625142 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e0f4f507-8ec2-43a3-85c4-efc6c7fc5856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:34.643173 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-e0f4f507-8ec2-43a3-85c4-efc6c7fc5856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Getting quotas for project 24634d5b4d5a42479f08bfb638cdd78d. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:31:34.647189 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-e0f4f507-8ec2-43a3-85c4-efc6c7fc5856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Getting quotas for user 10a6cc51b90e45d5a484e403dbbab488 and project 24634d5b4d5a42479f08bfb638cdd78d. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:31:34.658873 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e0f4f507-8ec2-43a3-85c4-efc6c7fc5856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Going to run 1 instances... {{(pid=116675) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 09:31:34.661340 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e0f4f507-8ec2-43a3-85c4-efc6c7fc5856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f828f0b-c445-46a5-9960-492746785ef3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 09:31:34.783955 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e0f4f507-8ec2-43a3-85c4-efc6c7fc5856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647691 Dec 20 09:31:34.784605 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 232/490] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 20 09:31:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 09:31:34.795423 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-539ce45d-d01c-4972-90ed-6b85d3d9ed87 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:34.796174 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-539ce45d-d01c-4972-90ed-6b85d3d9ed87 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:34.850452 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-539ce45d-d01c-4972-90ed-6b85d3d9ed87 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:34.857793 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-539ce45d-d01c-4972-90ed-6b85d3d9ed87 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1218 microversion: 2.1 time: 0.066969 Dec 20 09:31:34.858294 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 259/491] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:34 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:35.034040 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ce0b2ddb-de62-4a63-b17c-9eccdf2113e3 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:35.034746 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ce0b2ddb-de62-4a63-b17c-9eccdf2113e3 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:35.041249 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ce0b2ddb-de62-4a63-b17c-9eccdf2113e3 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:35.041790 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ce0b2ddb-de62-4a63-b17c-9eccdf2113e3 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:35.043178 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ce0b2ddb-de62-4a63-b17c-9eccdf2113e3 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:35.043887 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ce0b2ddb-de62-4a63-b17c-9eccdf2113e3 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:35.104246 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ce0b2ddb-de62-4a63-b17c-9eccdf2113e3 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:35.118603 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ce0b2ddb-de62-4a63-b17c-9eccdf2113e3 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1222 microversion: 2.1 time: 0.087013 Dec 20 09:31:35.119518 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 233/492] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:35 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:35.139507 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d27de4a0-d9a4-4d8c-8630-bfe343420c78 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:35.140737 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d27de4a0-d9a4-4d8c-8630-bfe343420c78 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:35.149190 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d27de4a0-d9a4-4d8c-8630-bfe343420c78 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:35.149641 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d27de4a0-d9a4-4d8c-8630-bfe343420c78 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:35.150431 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d27de4a0-d9a4-4d8c-8630-bfe343420c78 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:35.150860 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d27de4a0-d9a4-4d8c-8630-bfe343420c78 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:35.285087 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d27de4a0-d9a4-4d8c-8630-bfe343420c78 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.150880 Dec 20 09:31:35.286100 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 260/493] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:35 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:31:35.874020 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2118e3cd-8607-496f-a36a-961b7de2bf24 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:35.874627 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2118e3cd-8607-496f-a36a-961b7de2bf24 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:35.881184 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2118e3cd-8607-496f-a36a-961b7de2bf24 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:35.881631 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2118e3cd-8607-496f-a36a-961b7de2bf24 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:35.882409 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2118e3cd-8607-496f-a36a-961b7de2bf24 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:35.882848 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2118e3cd-8607-496f-a36a-961b7de2bf24 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:35.942974 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-2118e3cd-8607-496f-a36a-961b7de2bf24 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:35.950260 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2118e3cd-8607-496f-a36a-961b7de2bf24 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1222 microversion: 2.1 time: 0.079800 Dec 20 09:31:35.950770 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 234/494] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:35 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:36.136829 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f4aad8aa-a97c-44dd-b4b9-fe52af69d77a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:36.143206 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f4aad8aa-a97c-44dd-b4b9-fe52af69d77a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:36.144347 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f4aad8aa-a97c-44dd-b4b9-fe52af69d77a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:36.144796 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f4aad8aa-a97c-44dd-b4b9-fe52af69d77a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:36.145576 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f4aad8aa-a97c-44dd-b4b9-fe52af69d77a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:36.146018 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f4aad8aa-a97c-44dd-b4b9-fe52af69d77a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:36.210059 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f4aad8aa-a97c-44dd-b4b9-fe52af69d77a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:36.214550 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f4aad8aa-a97c-44dd-b4b9-fe52af69d77a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1214 microversion: 2.1 time: 0.081736 Dec 20 09:31:36.215112 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 261/495] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:36 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:36.296658 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-7aa7d6a6-1d5a-4420-a8c5-8c259a1fc63a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:36.297619 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-7aa7d6a6-1d5a-4420-a8c5-8c259a1fc63a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:36.303352 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7aa7d6a6-1d5a-4420-a8c5-8c259a1fc63a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:36.303834 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7aa7d6a6-1d5a-4420-a8c5-8c259a1fc63a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:36.304590 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7aa7d6a6-1d5a-4420-a8c5-8c259a1fc63a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:36.305015 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7aa7d6a6-1d5a-4420-a8c5-8c259a1fc63a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:36.966413 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ca9205f8-9baf-4ca5-ac16-9f53bd566788 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:36.967065 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ca9205f8-9baf-4ca5-ac16-9f53bd566788 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:36.973483 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ca9205f8-9baf-4ca5-ac16-9f53bd566788 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:36.973935 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ca9205f8-9baf-4ca5-ac16-9f53bd566788 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:36.974708 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ca9205f8-9baf-4ca5-ac16-9f53bd566788 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:36.975142 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ca9205f8-9baf-4ca5-ac16-9f53bd566788 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:37.034014 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ca9205f8-9baf-4ca5-ac16-9f53bd566788 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:37.041099 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ca9205f8-9baf-4ca5-ac16-9f53bd566788 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1222 microversion: 2.1 time: 0.078809 Dec 20 09:31:37.041672 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 262/496] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:36 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:37.231573 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d430e558-c87c-4940-9773-e24b627a996b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:37.232217 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d430e558-c87c-4940-9773-e24b627a996b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:37.238416 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d430e558-c87c-4940-9773-e24b627a996b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:37.238863 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d430e558-c87c-4940-9773-e24b627a996b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:37.239633 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d430e558-c87c-4940-9773-e24b627a996b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:37.240094 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d430e558-c87c-4940-9773-e24b627a996b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:37.307064 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d430e558-c87c-4940-9773-e24b627a996b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:37.314783 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d430e558-c87c-4940-9773-e24b627a996b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1214 microversion: 2.1 time: 0.087364 Dec 20 09:31:37.315351 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 263/497] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:37 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:38.058151 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c6fcf5ed-6121-4f32-bc01-aa7085a2fdd5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:38.058695 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c6fcf5ed-6121-4f32-bc01-aa7085a2fdd5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:38.064911 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c6fcf5ed-6121-4f32-bc01-aa7085a2fdd5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:38.065355 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c6fcf5ed-6121-4f32-bc01-aa7085a2fdd5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:38.066126 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c6fcf5ed-6121-4f32-bc01-aa7085a2fdd5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:38.066561 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c6fcf5ed-6121-4f32-bc01-aa7085a2fdd5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:38.125613 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-c6fcf5ed-6121-4f32-bc01-aa7085a2fdd5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:38.132920 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c6fcf5ed-6121-4f32-bc01-aa7085a2fdd5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1222 microversion: 2.1 time: 0.078561 Dec 20 09:31:38.133508 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 264/498] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:38 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:38.331784 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-01c0264c-58e5-46e4-958d-437865077728 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:38.332388 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-01c0264c-58e5-46e4-958d-437865077728 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:38.338279 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-01c0264c-58e5-46e4-958d-437865077728 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:38.338727 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-01c0264c-58e5-46e4-958d-437865077728 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:38.340338 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-01c0264c-58e5-46e4-958d-437865077728 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:38.340775 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-01c0264c-58e5-46e4-958d-437865077728 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:38.398458 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-01c0264c-58e5-46e4-958d-437865077728 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:38.406132 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-01c0264c-58e5-46e4-958d-437865077728 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1214 microversion: 2.1 time: 0.078379 Dec 20 09:31:38.406817 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 265/499] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:38 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:38.993659 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-7aa7d6a6-1d5a-4420-a8c5-8c259a1fc63a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 2.700425 Dec 20 09:31:38.994322 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 235/500] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:36 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 2702 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:31:39.148808 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b9bcdf1f-5271-4d7a-8f0d-1eb56151d38c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:39.149421 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b9bcdf1f-5271-4d7a-8f0d-1eb56151d38c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:39.156612 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b9bcdf1f-5271-4d7a-8f0d-1eb56151d38c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:39.157060 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b9bcdf1f-5271-4d7a-8f0d-1eb56151d38c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:39.157922 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b9bcdf1f-5271-4d7a-8f0d-1eb56151d38c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:39.158356 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b9bcdf1f-5271-4d7a-8f0d-1eb56151d38c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:39.224432 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b9bcdf1f-5271-4d7a-8f0d-1eb56151d38c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:39.232374 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b9bcdf1f-5271-4d7a-8f0d-1eb56151d38c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1222 microversion: 2.1 time: 0.087257 Dec 20 09:31:39.233466 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 266/501] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:39 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:39.426767 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-89487f98-7552-4090-bac7-cea6d77465c7 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:39.427570 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-89487f98-7552-4090-bac7-cea6d77465c7 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:39.434941 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-89487f98-7552-4090-bac7-cea6d77465c7 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:39.435374 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-89487f98-7552-4090-bac7-cea6d77465c7 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:39.436174 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-89487f98-7552-4090-bac7-cea6d77465c7 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:39.436605 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-89487f98-7552-4090-bac7-cea6d77465c7 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:39.508025 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-89487f98-7552-4090-bac7-cea6d77465c7 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:39.516133 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-89487f98-7552-4090-bac7-cea6d77465c7 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1270 microversion: 2.1 time: 0.093421 Dec 20 09:31:39.516703 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 236/502] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:39 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:40.005639 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-628d0c8f-f5e1-4bef-b6c3-78bd4b36de44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:40.006556 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-628d0c8f-f5e1-4bef-b6c3-78bd4b36de44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:40.013309 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-628d0c8f-f5e1-4bef-b6c3-78bd4b36de44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:40.013570 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-628d0c8f-f5e1-4bef-b6c3-78bd4b36de44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:40.020713 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-628d0c8f-f5e1-4bef-b6c3-78bd4b36de44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:40.020713 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-628d0c8f-f5e1-4bef-b6c3-78bd4b36de44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:40.084709 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-628d0c8f-f5e1-4bef-b6c3-78bd4b36de44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.082474 Dec 20 09:31:40.085396 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 267/503] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:40 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:31:40.194362 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 20 09:31:40.194564 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: Mon Dec 20 09:31:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 20 09:31:40.250439 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-710a214b-5985-4bd9-a0a3-1b0802598d2f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:40.251589 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-710a214b-5985-4bd9-a0a3-1b0802598d2f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:40.258413 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-710a214b-5985-4bd9-a0a3-1b0802598d2f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:40.258865 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-710a214b-5985-4bd9-a0a3-1b0802598d2f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:40.259747 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-710a214b-5985-4bd9-a0a3-1b0802598d2f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:40.260170 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-710a214b-5985-4bd9-a0a3-1b0802598d2f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:40.348079 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-710a214b-5985-4bd9-a0a3-1b0802598d2f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:40.359251 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-710a214b-5985-4bd9-a0a3-1b0802598d2f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1270 microversion: 2.1 time: 0.113316 Dec 20 09:31:40.369098 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 237/504] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:40 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1270 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:40.533868 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4e851f02-0292-420c-a2cc-7ae1146d9c3f tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:40.534580 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-4e851f02-0292-420c-a2cc-7ae1146d9c3f tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:40.541628 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4e851f02-0292-420c-a2cc-7ae1146d9c3f tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:40.542084 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4e851f02-0292-420c-a2cc-7ae1146d9c3f tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:40.543631 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4e851f02-0292-420c-a2cc-7ae1146d9c3f tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:40.544097 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4e851f02-0292-420c-a2cc-7ae1146d9c3f tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:40.609154 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-4e851f02-0292-420c-a2cc-7ae1146d9c3f tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:40.617582 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-4e851f02-0292-420c-a2cc-7ae1146d9c3f tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1288 microversion: 2.1 time: 0.087923 Dec 20 09:31:40.618588 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 268/505] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:40 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1288 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:41.096935 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-5e30c19c-156d-4827-8b22-10b6e244d3cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:41.097958 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-5e30c19c-156d-4827-8b22-10b6e244d3cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:41.104443 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5e30c19c-156d-4827-8b22-10b6e244d3cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:41.105196 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5e30c19c-156d-4827-8b22-10b6e244d3cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:41.107992 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5e30c19c-156d-4827-8b22-10b6e244d3cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:41.107992 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5e30c19c-156d-4827-8b22-10b6e244d3cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:41.186419 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-5e30c19c-156d-4827-8b22-10b6e244d3cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.093174 Dec 20 09:31:41.187067 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 238/506] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:41 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:31:41.382586 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-95a9a891-31c6-4dfc-97f0-0b7b07e0d7d3 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:41.383200 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-95a9a891-31c6-4dfc-97f0-0b7b07e0d7d3 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:41.389519 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-95a9a891-31c6-4dfc-97f0-0b7b07e0d7d3 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:41.389964 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-95a9a891-31c6-4dfc-97f0-0b7b07e0d7d3 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:41.390755 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-95a9a891-31c6-4dfc-97f0-0b7b07e0d7d3 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:41.391181 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-95a9a891-31c6-4dfc-97f0-0b7b07e0d7d3 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:41.464076 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-95a9a891-31c6-4dfc-97f0-0b7b07e0d7d3 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:41.472815 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-95a9a891-31c6-4dfc-97f0-0b7b07e0d7d3 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1276 microversion: 2.1 time: 0.093744 Dec 20 09:31:41.473709 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 269/507] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:41 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1276 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:41.638773 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-5f503fcf-d255-41e9-b817-fda35b90b420 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:41.639627 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-5f503fcf-d255-41e9-b817-fda35b90b420 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:41.646597 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5f503fcf-d255-41e9-b817-fda35b90b420 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:41.647125 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5f503fcf-d255-41e9-b817-fda35b90b420 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:41.648009 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5f503fcf-d255-41e9-b817-fda35b90b420 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:41.648510 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5f503fcf-d255-41e9-b817-fda35b90b420 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:41.783276 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-5f503fcf-d255-41e9-b817-fda35b90b420 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:41.790639 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-5f503fcf-d255-41e9-b817-fda35b90b420 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1318 microversion: 2.1 time: 0.156443 Dec 20 09:31:41.791217 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 239/508] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:41 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:42.197608 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a059251f-bd71-43f3-8428-7ab5133ea402 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:42.198731 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a059251f-bd71-43f3-8428-7ab5133ea402 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:42.204794 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a059251f-bd71-43f3-8428-7ab5133ea402 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:42.205317 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a059251f-bd71-43f3-8428-7ab5133ea402 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:42.206165 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a059251f-bd71-43f3-8428-7ab5133ea402 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:42.206669 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a059251f-bd71-43f3-8428-7ab5133ea402 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:42.282005 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a059251f-bd71-43f3-8428-7ab5133ea402 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.087875 Dec 20 09:31:42.282646 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 270/509] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:42 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:31:42.334630 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-9f5fee9e-3414-4658-a4fc-a18969ce5078 req-21302999-fc26-449c-905e-d8219432867b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dd9e0f3-3b58-47b2-a0cf-318133fa48cf", "tag": "e104443e-dbfd-42a1-b9cb-fd04cb2169af"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:42.336243 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:31:42.336243 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:31:42.344818 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-9f5fee9e-3414-4658-a4fc-a18969ce5078 req-21302999-fc26-449c-905e-d8219432867b service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:42.345262 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-9f5fee9e-3414-4658-a4fc-a18969ce5078 req-21302999-fc26-449c-905e-d8219432867b service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:42.355831 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-9f5fee9e-3414-4658-a4fc-a18969ce5078 req-21302999-fc26-449c-905e-d8219432867b service nova] Creating event network-changed:e104443e-dbfd-42a1-b9cb-fd04cb2169af for instance 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf on hv-cinder-81908 Dec 20 09:31:42.360899 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-9f5fee9e-3414-4658-a4fc-a18969ce5078 req-21302999-fc26-449c-905e-d8219432867b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031130 Dec 20 09:31:42.361502 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 240/510] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:31:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:31:42.494499 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4e6dc4dc-30de-4194-8306-cfa7770e55d5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:42.495790 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-4e6dc4dc-30de-4194-8306-cfa7770e55d5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:42.504330 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4e6dc4dc-30de-4194-8306-cfa7770e55d5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:42.504780 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4e6dc4dc-30de-4194-8306-cfa7770e55d5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:42.505567 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4e6dc4dc-30de-4194-8306-cfa7770e55d5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:42.506002 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4e6dc4dc-30de-4194-8306-cfa7770e55d5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:42.641958 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-4e6dc4dc-30de-4194-8306-cfa7770e55d5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:42.649116 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-4e6dc4dc-30de-4194-8306-cfa7770e55d5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1318 microversion: 2.1 time: 0.159708 Dec 20 09:31:42.649685 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 271/511] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:42 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:42.818343 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-eb805cf3-0942-4512-bafc-37f956a0e088 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:42.818343 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-eb805cf3-0942-4512-bafc-37f956a0e088 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:42.821286 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eb805cf3-0942-4512-bafc-37f956a0e088 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:42.821730 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eb805cf3-0942-4512-bafc-37f956a0e088 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:42.822495 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eb805cf3-0942-4512-bafc-37f956a0e088 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:42.822922 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eb805cf3-0942-4512-bafc-37f956a0e088 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:42.956771 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-eb805cf3-0942-4512-bafc-37f956a0e088 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:42.964598 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-eb805cf3-0942-4512-bafc-37f956a0e088 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1318 microversion: 2.1 time: 0.154514 Dec 20 09:31:42.965382 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 241/512] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:42 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:43.294661 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0857cbad-7e71-40c2-979d-6246796fae14 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:43.295703 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0857cbad-7e71-40c2-979d-6246796fae14 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:43.303063 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0857cbad-7e71-40c2-979d-6246796fae14 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:43.303558 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0857cbad-7e71-40c2-979d-6246796fae14 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:43.304495 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0857cbad-7e71-40c2-979d-6246796fae14 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:43.304798 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0857cbad-7e71-40c2-979d-6246796fae14 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:43.413191 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0857cbad-7e71-40c2-979d-6246796fae14 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.120337 Dec 20 09:31:43.413191 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 272/513] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:43 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:31:43.666082 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-cc085f71-83df-43a7-a545-68e36c9d315f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:43.666816 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-cc085f71-83df-43a7-a545-68e36c9d315f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:43.673519 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cc085f71-83df-43a7-a545-68e36c9d315f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:43.674096 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cc085f71-83df-43a7-a545-68e36c9d315f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:43.674872 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cc085f71-83df-43a7-a545-68e36c9d315f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:43.675301 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cc085f71-83df-43a7-a545-68e36c9d315f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:43.807715 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-cc085f71-83df-43a7-a545-68e36c9d315f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:43.815383 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-cc085f71-83df-43a7-a545-68e36c9d315f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1318 microversion: 2.1 time: 0.153354 Dec 20 09:31:43.815987 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 242/514] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:43 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:43.982429 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4d610295-b4a4-455d-9b3a-b0fda61ac7b0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:43.983130 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-4d610295-b4a4-455d-9b3a-b0fda61ac7b0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:43.990046 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4d610295-b4a4-455d-9b3a-b0fda61ac7b0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:43.990500 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4d610295-b4a4-455d-9b3a-b0fda61ac7b0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:43.991285 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4d610295-b4a4-455d-9b3a-b0fda61ac7b0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:43.991744 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4d610295-b4a4-455d-9b3a-b0fda61ac7b0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:44.126432 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-4d610295-b4a4-455d-9b3a-b0fda61ac7b0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:44.134136 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-4d610295-b4a4-455d-9b3a-b0fda61ac7b0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1318 microversion: 2.1 time: 0.156178 Dec 20 09:31:44.134705 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 273/515] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:43 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:44.380199 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-21ec8b97-f2b5-4a91-93ef-36002aba6f6a req-638a5794-3929-4f1d-b4a2-0998eef6264d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68a3fbd7-ef09-4f47-997e-918723eb5105", "tag": "c79de5a3-3016-4906-8def-63e5bc5e12f8"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:44.381735 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:31:44.381735 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:31:44.390031 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-21ec8b97-f2b5-4a91-93ef-36002aba6f6a req-638a5794-3929-4f1d-b4a2-0998eef6264d service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:44.390765 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-21ec8b97-f2b5-4a91-93ef-36002aba6f6a req-638a5794-3929-4f1d-b4a2-0998eef6264d service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:44.403253 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-21ec8b97-f2b5-4a91-93ef-36002aba6f6a req-638a5794-3929-4f1d-b4a2-0998eef6264d service nova] Creating event network-changed:c79de5a3-3016-4906-8def-63e5bc5e12f8 for instance 68a3fbd7-ef09-4f47-997e-918723eb5105 on hv-cinder-81908 Dec 20 09:31:44.411482 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-21ec8b97-f2b5-4a91-93ef-36002aba6f6a req-638a5794-3929-4f1d-b4a2-0998eef6264d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034527 Dec 20 09:31:44.411873 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 243/516] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:31:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:31:44.422713 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1a86ea5e-a809-4e96-ac0a-a0019e07e0b0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:44.424008 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-1a86ea5e-a809-4e96-ac0a-a0019e07e0b0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:44.430024 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1a86ea5e-a809-4e96-ac0a-a0019e07e0b0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:44.430659 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1a86ea5e-a809-4e96-ac0a-a0019e07e0b0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:44.431514 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1a86ea5e-a809-4e96-ac0a-a0019e07e0b0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:44.431967 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1a86ea5e-a809-4e96-ac0a-a0019e07e0b0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:44.833689 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c880f22c-f86a-4903-bdcf-97eac7de7640 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:44.834303 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c880f22c-f86a-4903-bdcf-97eac7de7640 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:44.841000 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c880f22c-f86a-4903-bdcf-97eac7de7640 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:44.841449 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c880f22c-f86a-4903-bdcf-97eac7de7640 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:44.842229 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c880f22c-f86a-4903-bdcf-97eac7de7640 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:44.842666 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c880f22c-f86a-4903-bdcf-97eac7de7640 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:44.985592 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-c880f22c-f86a-4903-bdcf-97eac7de7640 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:44.988604 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c880f22c-f86a-4903-bdcf-97eac7de7640 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1318 microversion: 2.1 time: 0.159532 Dec 20 09:31:44.989201 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 244/517] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:44 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:45.151895 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e513d72e-5b0a-45b8-ab5b-5c98a3f2ecfd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:45.152501 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e513d72e-5b0a-45b8-ab5b-5c98a3f2ecfd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:45.158273 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e513d72e-5b0a-45b8-ab5b-5c98a3f2ecfd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:45.162397 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e513d72e-5b0a-45b8-ab5b-5c98a3f2ecfd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:45.162397 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e513d72e-5b0a-45b8-ab5b-5c98a3f2ecfd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:45.162397 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e513d72e-5b0a-45b8-ab5b-5c98a3f2ecfd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:45.289641 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e513d72e-5b0a-45b8-ab5b-5c98a3f2ecfd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:45.297317 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e513d72e-5b0a-45b8-ab5b-5c98a3f2ecfd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1318 microversion: 2.1 time: 0.149459 Dec 20 09:31:45.297884 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 245/518] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:45 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:45.572191 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1a86ea5e-a809-4e96-ac0a-a0019e07e0b0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 1.152825 Dec 20 09:31:45.573096 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 274/519] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:44 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:31:46.007013 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d849463c-8959-4707-b27e-7296a7615e09 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:46.007507 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d849463c-8959-4707-b27e-7296a7615e09 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:46.014343 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d849463c-8959-4707-b27e-7296a7615e09 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:46.014797 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d849463c-8959-4707-b27e-7296a7615e09 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:46.015580 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d849463c-8959-4707-b27e-7296a7615e09 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:46.016047 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d849463c-8959-4707-b27e-7296a7615e09 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:46.152755 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d849463c-8959-4707-b27e-7296a7615e09 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:46.159849 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d849463c-8959-4707-b27e-7296a7615e09 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1318 microversion: 2.1 time: 0.156535 Dec 20 09:31:46.160409 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 246/520] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:46 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:46.314637 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c67462eb-d858-44c6-af10-277c721e2715 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:46.315270 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c67462eb-d858-44c6-af10-277c721e2715 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:46.322105 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c67462eb-d858-44c6-af10-277c721e2715 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:46.322552 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c67462eb-d858-44c6-af10-277c721e2715 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:46.323324 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c67462eb-d858-44c6-af10-277c721e2715 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:46.324295 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c67462eb-d858-44c6-af10-277c721e2715 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:46.463909 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-c67462eb-d858-44c6-af10-277c721e2715 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:46.470982 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c67462eb-d858-44c6-af10-277c721e2715 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1318 microversion: 2.1 time: 0.161000 Dec 20 09:31:46.471544 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 275/521] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:46 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:46.584462 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-fe65f144-a44c-41e0-9e96-8fb15b46a8bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:46.585330 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-fe65f144-a44c-41e0-9e96-8fb15b46a8bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:46.591590 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fe65f144-a44c-41e0-9e96-8fb15b46a8bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:46.592073 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fe65f144-a44c-41e0-9e96-8fb15b46a8bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:46.592842 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fe65f144-a44c-41e0-9e96-8fb15b46a8bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:46.593277 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fe65f144-a44c-41e0-9e96-8fb15b46a8bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:47.176000 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-2db53d0a-3f1f-4225-8b62-a24b035e2961 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:47.176607 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-2db53d0a-3f1f-4225-8b62-a24b035e2961 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:47.182807 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2db53d0a-3f1f-4225-8b62-a24b035e2961 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:47.183790 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2db53d0a-3f1f-4225-8b62-a24b035e2961 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:47.184564 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2db53d0a-3f1f-4225-8b62-a24b035e2961 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:47.184989 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2db53d0a-3f1f-4225-8b62-a24b035e2961 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:47.313220 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-2db53d0a-3f1f-4225-8b62-a24b035e2961 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:47.320677 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-2db53d0a-3f1f-4225-8b62-a24b035e2961 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1318 microversion: 2.1 time: 0.148286 Dec 20 09:31:47.321249 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 276/522] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:47 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:47.487721 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1539cbfc-6f5a-44c4-9fa2-e7ca114b116a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:47.488335 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-1539cbfc-6f5a-44c4-9fa2-e7ca114b116a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:47.494673 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1539cbfc-6f5a-44c4-9fa2-e7ca114b116a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:47.495130 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1539cbfc-6f5a-44c4-9fa2-e7ca114b116a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:47.495968 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1539cbfc-6f5a-44c4-9fa2-e7ca114b116a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:47.496404 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1539cbfc-6f5a-44c4-9fa2-e7ca114b116a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:47.621987 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1539cbfc-6f5a-44c4-9fa2-e7ca114b116a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:47.629066 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1539cbfc-6f5a-44c4-9fa2-e7ca114b116a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1318 microversion: 2.1 time: 0.144984 Dec 20 09:31:47.629627 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 277/523] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:47 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:48.337533 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3a3e5f56-be9a-4f43-8db2-73da3acbd258 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:48.338205 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-3a3e5f56-be9a-4f43-8db2-73da3acbd258 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:48.345071 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3a3e5f56-be9a-4f43-8db2-73da3acbd258 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:48.345523 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3a3e5f56-be9a-4f43-8db2-73da3acbd258 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:48.346305 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3a3e5f56-be9a-4f43-8db2-73da3acbd258 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:48.346740 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3a3e5f56-be9a-4f43-8db2-73da3acbd258 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:48.499429 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3a3e5f56-be9a-4f43-8db2-73da3acbd258 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:48.507006 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3a3e5f56-be9a-4f43-8db2-73da3acbd258 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1318 microversion: 2.1 time: 0.173261 Dec 20 09:31:48.507577 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 278/524] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:48 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:48.645802 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-570d2cb0-78d9-41a0-8656-563fdfabe89c tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:48.651261 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-570d2cb0-78d9-41a0-8656-563fdfabe89c tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:48.652190 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-570d2cb0-78d9-41a0-8656-563fdfabe89c tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:48.652638 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-570d2cb0-78d9-41a0-8656-563fdfabe89c tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:48.653446 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-570d2cb0-78d9-41a0-8656-563fdfabe89c tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:48.653882 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-570d2cb0-78d9-41a0-8656-563fdfabe89c tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:48.787105 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-570d2cb0-78d9-41a0-8656-563fdfabe89c tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:48.794850 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-570d2cb0-78d9-41a0-8656-563fdfabe89c tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1318 microversion: 2.1 time: 0.152573 Dec 20 09:31:48.795415 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 279/525] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:48 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:49.523173 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-bf19f1d4-587d-4efc-a9fc-5ec7c95a92e5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:49.523874 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-bf19f1d4-587d-4efc-a9fc-5ec7c95a92e5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:49.530117 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bf19f1d4-587d-4efc-a9fc-5ec7c95a92e5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:49.530568 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bf19f1d4-587d-4efc-a9fc-5ec7c95a92e5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:49.531347 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bf19f1d4-587d-4efc-a9fc-5ec7c95a92e5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:49.531822 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bf19f1d4-587d-4efc-a9fc-5ec7c95a92e5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:49.662467 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-bf19f1d4-587d-4efc-a9fc-5ec7c95a92e5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:49.670136 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-bf19f1d4-587d-4efc-a9fc-5ec7c95a92e5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1318 microversion: 2.1 time: 0.150665 Dec 20 09:31:49.670706 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 280/526] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:49 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:49.812975 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a0596dcb-998a-43cd-b4e0-33f2885ee866 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:49.813588 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a0596dcb-998a-43cd-b4e0-33f2885ee866 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:49.819446 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a0596dcb-998a-43cd-b4e0-33f2885ee866 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:49.819933 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a0596dcb-998a-43cd-b4e0-33f2885ee866 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:49.820721 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a0596dcb-998a-43cd-b4e0-33f2885ee866 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:49.821156 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a0596dcb-998a-43cd-b4e0-33f2885ee866 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:49.948449 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a0596dcb-998a-43cd-b4e0-33f2885ee866 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:49.955602 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a0596dcb-998a-43cd-b4e0-33f2885ee866 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1318 microversion: 2.1 time: 0.146319 Dec 20 09:31:49.956193 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 281/527] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:49 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:50.686998 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-35d396ec-9423-4ae0-b8c1-ab340e127490 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:50.687688 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-35d396ec-9423-4ae0-b8c1-ab340e127490 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:50.693944 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-35d396ec-9423-4ae0-b8c1-ab340e127490 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:50.694393 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-35d396ec-9423-4ae0-b8c1-ab340e127490 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:50.695172 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-35d396ec-9423-4ae0-b8c1-ab340e127490 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:50.695613 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-35d396ec-9423-4ae0-b8c1-ab340e127490 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:50.823441 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-35d396ec-9423-4ae0-b8c1-ab340e127490 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:50.830792 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-35d396ec-9423-4ae0-b8c1-ab340e127490 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1318 microversion: 2.1 time: 0.147459 Dec 20 09:31:50.831356 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 282/528] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:50 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:50.971566 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-fd4528e1-ef5a-4acf-a6d0-fa9770cc8408 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:50.972233 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-fd4528e1-ef5a-4acf-a6d0-fa9770cc8408 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:50.978215 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fd4528e1-ef5a-4acf-a6d0-fa9770cc8408 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:50.978664 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fd4528e1-ef5a-4acf-a6d0-fa9770cc8408 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:50.979938 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fd4528e1-ef5a-4acf-a6d0-fa9770cc8408 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:50.980406 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fd4528e1-ef5a-4acf-a6d0-fa9770cc8408 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:51.107680 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-fd4528e1-ef5a-4acf-a6d0-fa9770cc8408 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:51.114715 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-fd4528e1-ef5a-4acf-a6d0-fa9770cc8408 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1318 microversion: 2.1 time: 0.146719 Dec 20 09:31:51.115278 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 283/529] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:50 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:51.199105 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-fe65f144-a44c-41e0-9e96-8fb15b46a8bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 4.617567 Dec 20 09:31:51.200005 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 247/530] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:46 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 4620 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:31:51.846285 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-47582b9e-efec-4e51-aedb-bacd47d740f1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:51.846805 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-47582b9e-efec-4e51-aedb-bacd47d740f1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:51.853121 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-47582b9e-efec-4e51-aedb-bacd47d740f1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:51.853565 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-47582b9e-efec-4e51-aedb-bacd47d740f1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:51.854451 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-47582b9e-efec-4e51-aedb-bacd47d740f1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:51.855474 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-47582b9e-efec-4e51-aedb-bacd47d740f1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:51.981751 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-47582b9e-efec-4e51-aedb-bacd47d740f1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:51.988923 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-47582b9e-efec-4e51-aedb-bacd47d740f1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1318 microversion: 2.1 time: 0.146402 Dec 20 09:31:51.989486 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 284/531] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:51 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:52.132282 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d4ce132a-b749-47c0-8145-f5a001eeee78 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:52.132947 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d4ce132a-b749-47c0-8145-f5a001eeee78 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:52.140296 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d4ce132a-b749-47c0-8145-f5a001eeee78 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:52.140743 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d4ce132a-b749-47c0-8145-f5a001eeee78 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:52.141546 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d4ce132a-b749-47c0-8145-f5a001eeee78 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:52.141980 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d4ce132a-b749-47c0-8145-f5a001eeee78 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:52.210383 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7569ce5f-702d-4717-87dd-fa30a4353685 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:52.211282 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7569ce5f-702d-4717-87dd-fa30a4353685 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:52.217678 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7569ce5f-702d-4717-87dd-fa30a4353685 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:52.218116 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7569ce5f-702d-4717-87dd-fa30a4353685 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:52.218898 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7569ce5f-702d-4717-87dd-fa30a4353685 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:52.219323 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7569ce5f-702d-4717-87dd-fa30a4353685 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:52.273358 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d4ce132a-b749-47c0-8145-f5a001eeee78 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:52.281180 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d4ce132a-b749-47c0-8145-f5a001eeee78 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1318 microversion: 2.1 time: 0.152885 Dec 20 09:31:52.281754 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 248/532] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:52 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:52.606425 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7569ce5f-702d-4717-87dd-fa30a4353685 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.399552 Dec 20 09:31:52.607308 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 285/533] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:52 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:31:53.005618 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-fb39a76a-d6a6-491d-aec8-0428b189be3d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:53.006237 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-fb39a76a-d6a6-491d-aec8-0428b189be3d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:53.012667 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fb39a76a-d6a6-491d-aec8-0428b189be3d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:53.013119 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fb39a76a-d6a6-491d-aec8-0428b189be3d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:53.013899 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fb39a76a-d6a6-491d-aec8-0428b189be3d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:53.014388 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fb39a76a-d6a6-491d-aec8-0428b189be3d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:53.149525 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-fb39a76a-d6a6-491d-aec8-0428b189be3d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:53.157004 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-fb39a76a-d6a6-491d-aec8-0428b189be3d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1318 microversion: 2.1 time: 0.155282 Dec 20 09:31:53.157567 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 249/534] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:53 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:53.297978 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-217c9b3f-de9a-4748-83ca-defade29b04b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:53.298674 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-217c9b3f-de9a-4748-83ca-defade29b04b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:53.305635 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-217c9b3f-de9a-4748-83ca-defade29b04b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:53.306081 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-217c9b3f-de9a-4748-83ca-defade29b04b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:53.306856 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-217c9b3f-de9a-4748-83ca-defade29b04b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:53.307292 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-217c9b3f-de9a-4748-83ca-defade29b04b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:53.476226 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-217c9b3f-de9a-4748-83ca-defade29b04b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:53.480101 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-217c9b3f-de9a-4748-83ca-defade29b04b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1318 microversion: 2.1 time: 0.186047 Dec 20 09:31:53.481877 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 286/535] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:53 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:53.617892 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-bf9085f7-3457-4598-a52a-61fa80533525 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:53.618810 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-bf9085f7-3457-4598-a52a-61fa80533525 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:53.625104 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bf9085f7-3457-4598-a52a-61fa80533525 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:53.625823 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bf9085f7-3457-4598-a52a-61fa80533525 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:53.626596 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bf9085f7-3457-4598-a52a-61fa80533525 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:53.627034 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bf9085f7-3457-4598-a52a-61fa80533525 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:53.698595 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-bf9085f7-3457-4598-a52a-61fa80533525 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.084301 Dec 20 09:31:53.700612 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 250/536] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:53 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:31:54.173934 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-865245f2-5506-481e-9b39-7fd77fa5de2d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:54.174535 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-865245f2-5506-481e-9b39-7fd77fa5de2d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:54.180754 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-865245f2-5506-481e-9b39-7fd77fa5de2d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:54.181192 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-865245f2-5506-481e-9b39-7fd77fa5de2d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:54.181954 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-865245f2-5506-481e-9b39-7fd77fa5de2d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:54.182380 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-865245f2-5506-481e-9b39-7fd77fa5de2d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:54.312344 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-865245f2-5506-481e-9b39-7fd77fa5de2d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:54.323141 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-865245f2-5506-481e-9b39-7fd77fa5de2d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1318 microversion: 2.1 time: 0.149257 Dec 20 09:31:54.323141 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 287/537] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:54 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:54.498131 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d356655e-d572-4077-9254-35ad20d0d05a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:54.498826 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d356655e-d572-4077-9254-35ad20d0d05a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:54.505765 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d356655e-d572-4077-9254-35ad20d0d05a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:54.506207 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d356655e-d572-4077-9254-35ad20d0d05a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:54.507004 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d356655e-d572-4077-9254-35ad20d0d05a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:54.507432 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d356655e-d572-4077-9254-35ad20d0d05a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:54.647081 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d356655e-d572-4077-9254-35ad20d0d05a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:54.655551 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d356655e-d572-4077-9254-35ad20d0d05a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1318 microversion: 2.1 time: 0.161956 Dec 20 09:31:54.656239 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 251/538] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:54 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:54.710320 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-11a8a51b-35c1-437c-959e-8bbeac96b302 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:54.711242 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-11a8a51b-35c1-437c-959e-8bbeac96b302 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:54.718062 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-11a8a51b-35c1-437c-959e-8bbeac96b302 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:54.718514 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-11a8a51b-35c1-437c-959e-8bbeac96b302 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:54.719298 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-11a8a51b-35c1-437c-959e-8bbeac96b302 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:54.719763 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-11a8a51b-35c1-437c-959e-8bbeac96b302 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:54.783565 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-11a8a51b-35c1-437c-959e-8bbeac96b302 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.076857 Dec 20 09:31:54.784386 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 288/539] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:54 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:31:55.337306 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ad2539e4-ed7f-4b52-9f23-d8cb9920d5c1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:55.337910 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ad2539e4-ed7f-4b52-9f23-d8cb9920d5c1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:55.344332 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ad2539e4-ed7f-4b52-9f23-d8cb9920d5c1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:55.344781 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ad2539e4-ed7f-4b52-9f23-d8cb9920d5c1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:55.345556 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ad2539e4-ed7f-4b52-9f23-d8cb9920d5c1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:55.345992 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ad2539e4-ed7f-4b52-9f23-d8cb9920d5c1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:55.480454 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ad2539e4-ed7f-4b52-9f23-d8cb9920d5c1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:55.487771 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ad2539e4-ed7f-4b52-9f23-d8cb9920d5c1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1318 microversion: 2.1 time: 0.154130 Dec 20 09:31:55.488341 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 252/540] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:55 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:55.672605 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-84206487-49c0-4690-b6a4-8c335cef9c1c tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:55.673305 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-84206487-49c0-4690-b6a4-8c335cef9c1c tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:55.680391 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84206487-49c0-4690-b6a4-8c335cef9c1c tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:55.681044 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84206487-49c0-4690-b6a4-8c335cef9c1c tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:55.682030 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84206487-49c0-4690-b6a4-8c335cef9c1c tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:55.682625 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84206487-49c0-4690-b6a4-8c335cef9c1c tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:55.795822 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0b3be777-9625-43a6-b888-00c985b67af7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:55.796880 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0b3be777-9625-43a6-b888-00c985b67af7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:55.804002 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0b3be777-9625-43a6-b888-00c985b67af7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:55.804540 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0b3be777-9625-43a6-b888-00c985b67af7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:55.805713 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0b3be777-9625-43a6-b888-00c985b67af7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:55.806172 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0b3be777-9625-43a6-b888-00c985b67af7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:55.829509 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-84206487-49c0-4690-b6a4-8c335cef9c1c tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:55.837310 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-84206487-49c0-4690-b6a4-8c335cef9c1c tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1318 microversion: 2.1 time: 0.168707 Dec 20 09:31:55.837895 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 289/541] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:55 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:55.889981 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0b3be777-9625-43a6-b888-00c985b67af7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.098769 Dec 20 09:31:55.893741 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 253/542] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:55 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:31:56.504865 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-069c47d9-0efd-48d0-9fb6-ec27463a6bfe tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:56.505472 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-069c47d9-0efd-48d0-9fb6-ec27463a6bfe tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:56.512264 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-069c47d9-0efd-48d0-9fb6-ec27463a6bfe tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:56.512756 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-069c47d9-0efd-48d0-9fb6-ec27463a6bfe tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:56.513531 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-069c47d9-0efd-48d0-9fb6-ec27463a6bfe tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:56.513964 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-069c47d9-0efd-48d0-9fb6-ec27463a6bfe tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:56.646081 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-069c47d9-0efd-48d0-9fb6-ec27463a6bfe tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:56.654119 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-069c47d9-0efd-48d0-9fb6-ec27463a6bfe tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1318 microversion: 2.1 time: 0.152826 Dec 20 09:31:56.664877 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 290/543] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:56 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:56.854741 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-49c18224-434e-4c42-8bcb-383ab377c856 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:56.856098 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-49c18224-434e-4c42-8bcb-383ab377c856 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:56.865313 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-49c18224-434e-4c42-8bcb-383ab377c856 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:56.865880 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-49c18224-434e-4c42-8bcb-383ab377c856 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:56.866921 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-49c18224-434e-4c42-8bcb-383ab377c856 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:56.867544 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-49c18224-434e-4c42-8bcb-383ab377c856 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:56.901007 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-fcc18fd3-515f-4d3f-b5ca-1d45d3e43efe tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:56.903083 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-fcc18fd3-515f-4d3f-b5ca-1d45d3e43efe tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:56.911071 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fcc18fd3-515f-4d3f-b5ca-1d45d3e43efe tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:56.911803 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fcc18fd3-515f-4d3f-b5ca-1d45d3e43efe tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:56.912770 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fcc18fd3-515f-4d3f-b5ca-1d45d3e43efe tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:56.913375 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fcc18fd3-515f-4d3f-b5ca-1d45d3e43efe tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:57.011049 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-49c18224-434e-4c42-8bcb-383ab377c856 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:57.013216 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-fcc18fd3-515f-4d3f-b5ca-1d45d3e43efe tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.115527 Dec 20 09:31:57.014021 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 291/544] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:56 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:31:57.019432 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-49c18224-434e-4c42-8bcb-383ab377c856 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1318 microversion: 2.1 time: 0.168705 Dec 20 09:31:57.020026 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 254/545] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:56 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:57.672103 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4eb053e8-efdb-42d1-966c-8ecd0e695444 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:57.672929 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-4eb053e8-efdb-42d1-966c-8ecd0e695444 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:57.679829 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4eb053e8-efdb-42d1-966c-8ecd0e695444 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:57.680233 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4eb053e8-efdb-42d1-966c-8ecd0e695444 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:57.681164 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4eb053e8-efdb-42d1-966c-8ecd0e695444 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:57.681652 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4eb053e8-efdb-42d1-966c-8ecd0e695444 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:57.822181 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-4eb053e8-efdb-42d1-966c-8ecd0e695444 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:57.830072 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-4eb053e8-efdb-42d1-966c-8ecd0e695444 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1318 microversion: 2.1 time: 0.163464 Dec 20 09:31:57.830633 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 292/546] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:57 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:31:58.029098 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-fa9c53ed-c995-4871-932a-832db476e831 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:31:58.029098 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-fa9c53ed-c995-4871-932a-832db476e831 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:58.032673 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fa9c53ed-c995-4871-932a-832db476e831 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:58.033124 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fa9c53ed-c995-4871-932a-832db476e831 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:58.033910 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fa9c53ed-c995-4871-932a-832db476e831 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:58.034346 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fa9c53ed-c995-4871-932a-832db476e831 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:58.036071 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-68501196-98d9-4f67-9a42-b5b3d0ff95ad tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:58.036682 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-68501196-98d9-4f67-9a42-b5b3d0ff95ad tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:58.043501 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-68501196-98d9-4f67-9a42-b5b3d0ff95ad tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:58.043969 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-68501196-98d9-4f67-9a42-b5b3d0ff95ad tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:58.044750 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-68501196-98d9-4f67-9a42-b5b3d0ff95ad tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:58.045356 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-68501196-98d9-4f67-9a42-b5b3d0ff95ad tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:58.181689 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-68501196-98d9-4f67-9a42-b5b3d0ff95ad tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:58.188887 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-68501196-98d9-4f67-9a42-b5b3d0ff95ad tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1318 microversion: 2.1 time: 0.156360 Dec 20 09:31:58.189523 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 293/547] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:58 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:58.846016 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-684e11cc-3602-4a53-99a5-550780c69c23 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:58.846625 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-684e11cc-3602-4a53-99a5-550780c69c23 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:58.852792 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-684e11cc-3602-4a53-99a5-550780c69c23 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:58.853357 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-684e11cc-3602-4a53-99a5-550780c69c23 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:58.853996 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-684e11cc-3602-4a53-99a5-550780c69c23 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:58.854430 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-684e11cc-3602-4a53-99a5-550780c69c23 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:58.982830 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-684e11cc-3602-4a53-99a5-550780c69c23 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:58.991872 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-684e11cc-3602-4a53-99a5-550780c69c23 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1318 microversion: 2.1 time: 0.147916 Dec 20 09:31:58.991872 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 294/548] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:58 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:31:59.206078 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f044ea6d-4dd3-4294-a564-a4ac1796267b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:31:59.206711 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f044ea6d-4dd3-4294-a564-a4ac1796267b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:31:59.212515 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f044ea6d-4dd3-4294-a564-a4ac1796267b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:59.212985 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f044ea6d-4dd3-4294-a564-a4ac1796267b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:59.213776 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f044ea6d-4dd3-4294-a564-a4ac1796267b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:31:59.214200 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f044ea6d-4dd3-4294-a564-a4ac1796267b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:31:59.346541 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f044ea6d-4dd3-4294-a564-a4ac1796267b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:31:59.353832 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f044ea6d-4dd3-4294-a564-a4ac1796267b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1318 microversion: 2.1 time: 0.151359 Dec 20 09:31:59.354399 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 295/549] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:31:59 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:00.006304 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3af2b091-f4ac-42dc-b480-ec9bba6a28b8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:00.006910 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-3af2b091-f4ac-42dc-b480-ec9bba6a28b8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:00.013068 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3af2b091-f4ac-42dc-b480-ec9bba6a28b8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:00.013509 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3af2b091-f4ac-42dc-b480-ec9bba6a28b8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:00.014285 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3af2b091-f4ac-42dc-b480-ec9bba6a28b8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:00.014718 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3af2b091-f4ac-42dc-b480-ec9bba6a28b8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:00.150731 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3af2b091-f4ac-42dc-b480-ec9bba6a28b8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:00.161684 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3af2b091-f4ac-42dc-b480-ec9bba6a28b8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1318 microversion: 2.1 time: 0.158993 Dec 20 09:32:00.162404 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 296/550] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:00 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:00.369989 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8b070a68-3ad5-4403-a1c0-80e521e030cc tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:00.371151 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-8b070a68-3ad5-4403-a1c0-80e521e030cc tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:00.377258 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8b070a68-3ad5-4403-a1c0-80e521e030cc tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:00.377711 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8b070a68-3ad5-4403-a1c0-80e521e030cc tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:00.378490 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8b070a68-3ad5-4403-a1c0-80e521e030cc tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:00.378925 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8b070a68-3ad5-4403-a1c0-80e521e030cc tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:00.506952 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-8b070a68-3ad5-4403-a1c0-80e521e030cc tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:00.514715 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8b070a68-3ad5-4403-a1c0-80e521e030cc tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1318 microversion: 2.1 time: 0.148366 Dec 20 09:32:00.515335 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 297/551] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:00 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:01.182342 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e701626c-47b4-4fd9-b84b-c18349ee1c90 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:01.182934 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e701626c-47b4-4fd9-b84b-c18349ee1c90 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:01.189121 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e701626c-47b4-4fd9-b84b-c18349ee1c90 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:01.189562 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e701626c-47b4-4fd9-b84b-c18349ee1c90 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:01.190323 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e701626c-47b4-4fd9-b84b-c18349ee1c90 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:01.190891 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e701626c-47b4-4fd9-b84b-c18349ee1c90 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:01.325284 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e701626c-47b4-4fd9-b84b-c18349ee1c90 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:01.332541 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e701626c-47b4-4fd9-b84b-c18349ee1c90 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1318 microversion: 2.1 time: 0.153816 Dec 20 09:32:01.333119 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 298/552] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:01 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:01.531739 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5d81ae16-ad7b-4434-aa27-9bcd1699352d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:01.532350 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-5d81ae16-ad7b-4434-aa27-9bcd1699352d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:01.538076 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5d81ae16-ad7b-4434-aa27-9bcd1699352d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:01.538524 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5d81ae16-ad7b-4434-aa27-9bcd1699352d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:01.539298 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5d81ae16-ad7b-4434-aa27-9bcd1699352d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:01.539760 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5d81ae16-ad7b-4434-aa27-9bcd1699352d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:01.666885 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-5d81ae16-ad7b-4434-aa27-9bcd1699352d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:01.674198 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-5d81ae16-ad7b-4434-aa27-9bcd1699352d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1318 microversion: 2.1 time: 0.146748 Dec 20 09:32:01.674766 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 299/553] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:01 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:01.777745 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-fa9c53ed-c995-4871-932a-832db476e831 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 3.756713 Dec 20 09:32:01.778691 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 255/554] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:31:58 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 3758 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:02.000140 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-4ed97b31-1243-4639-a610-a513f1795504 req-2752775d-fdbd-4f58-9d03-1abd4bb7cc31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68a3fbd7-ef09-4f47-997e-918723eb5105", "name": "network-vif-plugged", "status": "completed", "tag": "c79de5a3-3016-4906-8def-63e5bc5e12f8"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:02.002484 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:32:02.002484 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:32:02.009443 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-4ed97b31-1243-4639-a610-a513f1795504 req-2752775d-fdbd-4f58-9d03-1abd4bb7cc31 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:02.009916 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-4ed97b31-1243-4639-a610-a513f1795504 req-2752775d-fdbd-4f58-9d03-1abd4bb7cc31 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:02.021059 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-4ed97b31-1243-4639-a610-a513f1795504 req-2752775d-fdbd-4f58-9d03-1abd4bb7cc31 service nova] Creating event network-vif-plugged:c79de5a3-3016-4906-8def-63e5bc5e12f8 for instance 68a3fbd7-ef09-4f47-997e-918723eb5105 on hv-cinder-81908 Dec 20 09:32:02.025854 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-4ed97b31-1243-4639-a610-a513f1795504 req-2752775d-fdbd-4f58-9d03-1abd4bb7cc31 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030408 Dec 20 09:32:02.026450 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 300/555] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:32:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:32:02.349448 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-006d8704-9096-4cbf-b19b-3e9857008fbf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:02.350153 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-006d8704-9096-4cbf-b19b-3e9857008fbf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:02.357656 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-006d8704-9096-4cbf-b19b-3e9857008fbf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:02.358104 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-006d8704-9096-4cbf-b19b-3e9857008fbf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:02.358923 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-006d8704-9096-4cbf-b19b-3e9857008fbf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:02.359359 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-006d8704-9096-4cbf-b19b-3e9857008fbf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:02.494681 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-006d8704-9096-4cbf-b19b-3e9857008fbf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:02.502785 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-006d8704-9096-4cbf-b19b-3e9857008fbf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1318 microversion: 2.1 time: 0.157489 Dec 20 09:32:02.503357 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 256/556] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:02 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:02.691390 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f645ee11-9c53-45b0-ac0f-a7c45e5a664d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:02.692037 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f645ee11-9c53-45b0-ac0f-a7c45e5a664d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:02.698466 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f645ee11-9c53-45b0-ac0f-a7c45e5a664d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:02.698911 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f645ee11-9c53-45b0-ac0f-a7c45e5a664d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:02.699756 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f645ee11-9c53-45b0-ac0f-a7c45e5a664d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:02.700193 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f645ee11-9c53-45b0-ac0f-a7c45e5a664d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:02.789165 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6da59981-4afc-427a-8558-e433b51a64a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:02.790082 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6da59981-4afc-427a-8558-e433b51a64a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:02.796869 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6da59981-4afc-427a-8558-e433b51a64a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:02.797355 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6da59981-4afc-427a-8558-e433b51a64a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:02.798190 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6da59981-4afc-427a-8558-e433b51a64a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:02.798634 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6da59981-4afc-427a-8558-e433b51a64a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:02.830015 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f645ee11-9c53-45b0-ac0f-a7c45e5a664d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:02.837310 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f645ee11-9c53-45b0-ac0f-a7c45e5a664d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1318 microversion: 2.1 time: 0.149879 Dec 20 09:32:02.840217 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 301/557] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:02 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:02.938159 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6da59981-4afc-427a-8558-e433b51a64a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.152435 Dec 20 09:32:02.938872 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 257/558] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:02 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:32:03.519084 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-dda0c999-6e58-41ed-9429-8d07c70e1cc6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:03.519644 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-dda0c999-6e58-41ed-9429-8d07c70e1cc6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:03.525474 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dda0c999-6e58-41ed-9429-8d07c70e1cc6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:03.525923 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dda0c999-6e58-41ed-9429-8d07c70e1cc6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:03.526693 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dda0c999-6e58-41ed-9429-8d07c70e1cc6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:03.527129 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dda0c999-6e58-41ed-9429-8d07c70e1cc6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:03.665789 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-dda0c999-6e58-41ed-9429-8d07c70e1cc6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:03.677147 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-dda0c999-6e58-41ed-9429-8d07c70e1cc6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1318 microversion: 2.1 time: 0.161883 Dec 20 09:32:03.677729 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 302/559] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:03 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:03.854822 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-fdda6474-ffbc-4ecc-88b4-84e9a7c369bf tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:03.855527 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-fdda6474-ffbc-4ecc-88b4-84e9a7c369bf tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:03.862368 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fdda6474-ffbc-4ecc-88b4-84e9a7c369bf tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:03.862818 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fdda6474-ffbc-4ecc-88b4-84e9a7c369bf tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:03.863594 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fdda6474-ffbc-4ecc-88b4-84e9a7c369bf tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:03.864055 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fdda6474-ffbc-4ecc-88b4-84e9a7c369bf tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:03.949319 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ee3b477b-ed3c-42e9-b4be-827f08b55c1b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:03.950862 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ee3b477b-ed3c-42e9-b4be-827f08b55c1b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:03.961525 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ee3b477b-ed3c-42e9-b4be-827f08b55c1b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:03.962029 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ee3b477b-ed3c-42e9-b4be-827f08b55c1b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:03.964491 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ee3b477b-ed3c-42e9-b4be-827f08b55c1b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:03.964491 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ee3b477b-ed3c-42e9-b4be-827f08b55c1b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:04.006928 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-fdda6474-ffbc-4ecc-88b4-84e9a7c369bf tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:04.015020 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-fdda6474-ffbc-4ecc-88b4-84e9a7c369bf tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1318 microversion: 2.1 time: 0.164207 Dec 20 09:32:04.016003 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 258/560] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:03 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:04.039925 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ee3b477b-ed3c-42e9-b4be-827f08b55c1b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.094093 Dec 20 09:32:04.041660 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 303/561] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:03 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:32:04.042781 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-dbbc3698-43cc-448b-abb4-c71247aa6685 req-0902be94-1f92-4992-a44c-18b6e0f6fb58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd9e0f3-3b58-47b2-a0cf-318133fa48cf", "name": "network-vif-plugged", "status": "completed", "tag": "e104443e-dbfd-42a1-b9cb-fd04cb2169af"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:04.044954 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:32:04.044954 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:32:04.052513 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-dbbc3698-43cc-448b-abb4-c71247aa6685 req-0902be94-1f92-4992-a44c-18b6e0f6fb58 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:04.052951 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-dbbc3698-43cc-448b-abb4-c71247aa6685 req-0902be94-1f92-4992-a44c-18b6e0f6fb58 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:04.065200 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-dbbc3698-43cc-448b-abb4-c71247aa6685 req-0902be94-1f92-4992-a44c-18b6e0f6fb58 service nova] Creating event network-vif-plugged:e104443e-dbfd-42a1-b9cb-fd04cb2169af for instance 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf on hv-cinder-81908 Dec 20 09:32:04.070271 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-dbbc3698-43cc-448b-abb4-c71247aa6685 req-0902be94-1f92-4992-a44c-18b6e0f6fb58 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031955 Dec 20 09:32:04.071012 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 259/562] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:32:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:32:04.695001 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-256065c0-2cfb-43b5-9214-ac8f8bb445a0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:04.698519 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-256065c0-2cfb-43b5-9214-ac8f8bb445a0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:04.703440 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-256065c0-2cfb-43b5-9214-ac8f8bb445a0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:04.704168 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-256065c0-2cfb-43b5-9214-ac8f8bb445a0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:04.705148 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-256065c0-2cfb-43b5-9214-ac8f8bb445a0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:04.705596 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-256065c0-2cfb-43b5-9214-ac8f8bb445a0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:04.837046 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-256065c0-2cfb-43b5-9214-ac8f8bb445a0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:04.845083 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-256065c0-2cfb-43b5-9214-ac8f8bb445a0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1508 microversion: 2.1 time: 0.154148 Dec 20 09:32:04.845846 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 304/563] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:04 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:05.032569 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-7ecc65cd-5589-4619-bb95-9663908f1d02 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:05.033271 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-7ecc65cd-5589-4619-bb95-9663908f1d02 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:05.039164 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7ecc65cd-5589-4619-bb95-9663908f1d02 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:05.039626 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7ecc65cd-5589-4619-bb95-9663908f1d02 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:05.040439 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7ecc65cd-5589-4619-bb95-9663908f1d02 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:05.040876 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7ecc65cd-5589-4619-bb95-9663908f1d02 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:05.052411 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e361d7be-ddc4-4fe9-beb1-8690d56a326d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:05.053389 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e361d7be-ddc4-4fe9-beb1-8690d56a326d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:05.060323 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e361d7be-ddc4-4fe9-beb1-8690d56a326d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:05.060764 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e361d7be-ddc4-4fe9-beb1-8690d56a326d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:05.061533 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e361d7be-ddc4-4fe9-beb1-8690d56a326d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:05.061960 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e361d7be-ddc4-4fe9-beb1-8690d56a326d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:05.138776 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e361d7be-ddc4-4fe9-beb1-8690d56a326d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.088439 Dec 20 09:32:05.143767 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 305/564] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:05 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:32:05.193811 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-7ecc65cd-5589-4619-bb95-9663908f1d02 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:05.201798 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-7ecc65cd-5589-4619-bb95-9663908f1d02 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1318 microversion: 2.1 time: 0.173834 Dec 20 09:32:05.202425 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 260/565] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:05 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:06.151102 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-6b3411c0-ccdc-412f-b114-f871a0abf374 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:06.152269 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-6b3411c0-ccdc-412f-b114-f871a0abf374 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:06.159438 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6b3411c0-ccdc-412f-b114-f871a0abf374 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:06.159901 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6b3411c0-ccdc-412f-b114-f871a0abf374 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:06.160909 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6b3411c0-ccdc-412f-b114-f871a0abf374 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:06.161356 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6b3411c0-ccdc-412f-b114-f871a0abf374 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:06.218935 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d75d1d3e-3d85-42c8-892f-8d8eba96a950 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:06.219685 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d75d1d3e-3d85-42c8-892f-8d8eba96a950 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:06.227497 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d75d1d3e-3d85-42c8-892f-8d8eba96a950 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:06.227972 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d75d1d3e-3d85-42c8-892f-8d8eba96a950 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:06.228790 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d75d1d3e-3d85-42c8-892f-8d8eba96a950 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:06.229244 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d75d1d3e-3d85-42c8-892f-8d8eba96a950 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:06.296772 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-6b3411c0-ccdc-412f-b114-f871a0abf374 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.149556 Dec 20 09:32:06.297809 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 306/566] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:06 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:32:06.380257 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d75d1d3e-3d85-42c8-892f-8d8eba96a950 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:06.389287 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d75d1d3e-3d85-42c8-892f-8d8eba96a950 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1318 microversion: 2.1 time: 0.174840 Dec 20 09:32:06.389857 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 261/567] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:06 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:07.308176 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9355fe32-0e1a-4cab-aac8-a0bfb03757f2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:07.309197 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9355fe32-0e1a-4cab-aac8-a0bfb03757f2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:07.316070 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9355fe32-0e1a-4cab-aac8-a0bfb03757f2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:07.316522 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9355fe32-0e1a-4cab-aac8-a0bfb03757f2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:07.317297 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9355fe32-0e1a-4cab-aac8-a0bfb03757f2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:07.317735 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9355fe32-0e1a-4cab-aac8-a0bfb03757f2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:07.405716 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8d268403-7bb4-405d-a343-6f5e24376d56 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:07.406461 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8d268403-7bb4-405d-a343-6f5e24376d56 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:07.413337 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8d268403-7bb4-405d-a343-6f5e24376d56 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:07.413787 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8d268403-7bb4-405d-a343-6f5e24376d56 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:07.414565 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8d268403-7bb4-405d-a343-6f5e24376d56 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:07.414999 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8d268403-7bb4-405d-a343-6f5e24376d56 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:07.440986 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9355fe32-0e1a-4cab-aac8-a0bfb03757f2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.136700 Dec 20 09:32:07.442142 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 307/568] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:07 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:07.563351 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8d268403-7bb4-405d-a343-6f5e24376d56 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:07.571868 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8d268403-7bb4-405d-a343-6f5e24376d56 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1506 microversion: 2.1 time: 0.169779 Dec 20 09:32:07.581594 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 262/569] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:07 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:07.644036 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-27f5cbc3-6b53-4b30-886f-9c33152f273c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92941e0d-fa7b-4b53-9bee-687292150d00"}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:07.645171 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-27f5cbc3-6b53-4b30-886f-9c33152f273c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:07.653487 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-27f5cbc3-6b53-4b30-886f-9c33152f273c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:07.657835 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-27f5cbc3-6b53-4b30-886f-9c33152f273c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:07.657835 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-27f5cbc3-6b53-4b30-886f-9c33152f273c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:07.657835 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-27f5cbc3-6b53-4b30-886f-9c33152f273c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:08.458424 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d735a31b-bc92-420c-b8db-4493ee7f8fe5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:08.462952 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d735a31b-bc92-420c-b8db-4493ee7f8fe5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:08.466543 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d735a31b-bc92-420c-b8db-4493ee7f8fe5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:08.466990 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d735a31b-bc92-420c-b8db-4493ee7f8fe5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:08.467992 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d735a31b-bc92-420c-b8db-4493ee7f8fe5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:08.468431 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d735a31b-bc92-420c-b8db-4493ee7f8fe5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:08.544621 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d735a31b-bc92-420c-b8db-4493ee7f8fe5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.089816 Dec 20 09:32:08.545309 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 263/570] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:08 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:32:08.625635 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-27f5cbc3-6b53-4b30-886f-9c33152f273c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "POST /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.985316 Dec 20 09:32:08.626806 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 308/571] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 20 09:32:07 2021] POST /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105/os-volume_attachments => generated 194 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:32:08.697940 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-dd3f2741-3b48-4e3a-829e-e8d947243f40 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:08.699781 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-dd3f2741-3b48-4e3a-829e-e8d947243f40 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:08.707732 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-dd3f2741-3b48-4e3a-829e-e8d947243f40 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:08.708289 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-dd3f2741-3b48-4e3a-829e-e8d947243f40 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:08.709200 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-dd3f2741-3b48-4e3a-829e-e8d947243f40 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:08.709825 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-dd3f2741-3b48-4e3a-829e-e8d947243f40 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:08.749961 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.objects.instance [None req-dd3f2741-3b48-4e3a-829e-e8d947243f40 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lazy-loading 'flavor' on Instance uuid 1af8e934-5860-485f-abf5-42a2814d66e7 {{(pid=116675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:32:09.153849 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-dd3f2741-3b48-4e3a-829e-e8d947243f40 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "POST /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7/action" status: 200 len: 32 microversion: 2.1 time: 0.460591 Dec 20 09:32:09.154476 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 264/572] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:32:08 2021] POST /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7/action => generated 32 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 09:32:09.164859 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f86f829f-993c-4814-b24f-bf4e6070624a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:09.166692 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f86f829f-993c-4814-b24f-bf4e6070624a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:09.174017 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f86f829f-993c-4814-b24f-bf4e6070624a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:09.174465 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f86f829f-993c-4814-b24f-bf4e6070624a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:09.175280 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f86f829f-993c-4814-b24f-bf4e6070624a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:09.175771 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f86f829f-993c-4814-b24f-bf4e6070624a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:09.316685 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f86f829f-993c-4814-b24f-bf4e6070624a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:09.332830 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f86f829f-993c-4814-b24f-bf4e6070624a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1567 microversion: 2.1 time: 0.166845 Dec 20 09:32:09.332830 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 309/573] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:09 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:09.556572 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-57b99bd4-959c-4116-ad7f-b78f4be55508 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:09.557837 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-57b99bd4-959c-4116-ad7f-b78f4be55508 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:09.564920 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-57b99bd4-959c-4116-ad7f-b78f4be55508 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:09.565370 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-57b99bd4-959c-4116-ad7f-b78f4be55508 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:09.566145 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-57b99bd4-959c-4116-ad7f-b78f4be55508 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:09.566580 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-57b99bd4-959c-4116-ad7f-b78f4be55508 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:09.649809 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-57b99bd4-959c-4116-ad7f-b78f4be55508 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.097713 Dec 20 09:32:09.650465 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 265/574] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:09 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:10.344208 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a9bc8d05-9987-4bdb-8c13-c27743e8103a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:10.344824 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a9bc8d05-9987-4bdb-8c13-c27743e8103a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:10.351841 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a9bc8d05-9987-4bdb-8c13-c27743e8103a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:10.357210 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a9bc8d05-9987-4bdb-8c13-c27743e8103a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:10.357210 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a9bc8d05-9987-4bdb-8c13-c27743e8103a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:10.357210 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a9bc8d05-9987-4bdb-8c13-c27743e8103a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:10.489378 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a9bc8d05-9987-4bdb-8c13-c27743e8103a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:10.498497 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a9bc8d05-9987-4bdb-8c13-c27743e8103a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1567 microversion: 2.1 time: 0.158590 Dec 20 09:32:10.499085 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 310/575] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:10 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:10.661997 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a108dfc2-979c-4a16-b30e-f2b9be3d66ea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:10.663129 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a108dfc2-979c-4a16-b30e-f2b9be3d66ea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:10.670509 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a108dfc2-979c-4a16-b30e-f2b9be3d66ea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:10.678111 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a108dfc2-979c-4a16-b30e-f2b9be3d66ea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:10.678111 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a108dfc2-979c-4a16-b30e-f2b9be3d66ea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:10.678111 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a108dfc2-979c-4a16-b30e-f2b9be3d66ea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:10.743013 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a108dfc2-979c-4a16-b30e-f2b9be3d66ea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.084761 Dec 20 09:32:10.743580 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 266/576] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:10 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:11.516896 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-bbf7cab5-42db-4ec9-9856-7b0c0b60308b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:11.517492 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-bbf7cab5-42db-4ec9-9856-7b0c0b60308b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:11.523643 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bbf7cab5-42db-4ec9-9856-7b0c0b60308b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:11.524115 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bbf7cab5-42db-4ec9-9856-7b0c0b60308b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:11.524887 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bbf7cab5-42db-4ec9-9856-7b0c0b60308b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:11.525314 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bbf7cab5-42db-4ec9-9856-7b0c0b60308b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:11.672976 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-bbf7cab5-42db-4ec9-9856-7b0c0b60308b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:11.680941 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-bbf7cab5-42db-4ec9-9856-7b0c0b60308b tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1567 microversion: 2.1 time: 0.167716 Dec 20 09:32:11.687747 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 311/577] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:11 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:11.755456 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c3dca2d9-b02d-4473-8cc3-84142458af92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:11.756487 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c3dca2d9-b02d-4473-8cc3-84142458af92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:11.764283 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c3dca2d9-b02d-4473-8cc3-84142458af92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:11.764737 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c3dca2d9-b02d-4473-8cc3-84142458af92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:11.765529 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c3dca2d9-b02d-4473-8cc3-84142458af92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:11.765966 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c3dca2d9-b02d-4473-8cc3-84142458af92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:11.846137 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c3dca2d9-b02d-4473-8cc3-84142458af92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.094506 Dec 20 09:32:11.850115 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 267/578] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:11 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:12.698632 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f7fc97f8-abf6-4121-9c3f-eb09f7991a03 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:12.699574 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f7fc97f8-abf6-4121-9c3f-eb09f7991a03 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:12.706827 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f7fc97f8-abf6-4121-9c3f-eb09f7991a03 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:12.707554 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f7fc97f8-abf6-4121-9c3f-eb09f7991a03 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:12.708475 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f7fc97f8-abf6-4121-9c3f-eb09f7991a03 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:12.708858 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f7fc97f8-abf6-4121-9c3f-eb09f7991a03 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:12.853098 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f7fc97f8-abf6-4121-9c3f-eb09f7991a03 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:12.858076 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-281ccb05-e156-4166-8510-682927a42e37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:12.859237 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-281ccb05-e156-4166-8510-682927a42e37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:12.863139 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f7fc97f8-abf6-4121-9c3f-eb09f7991a03 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1567 microversion: 2.1 time: 0.168646 Dec 20 09:32:12.872167 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-281ccb05-e156-4166-8510-682927a42e37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:12.873904 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-281ccb05-e156-4166-8510-682927a42e37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:12.874700 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-281ccb05-e156-4166-8510-682927a42e37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:12.875413 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-281ccb05-e156-4166-8510-682927a42e37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:12.876752 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 312/579] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:12 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:12.954340 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-281ccb05-e156-4166-8510-682927a42e37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.100072 Dec 20 09:32:12.958170 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 268/580] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:12 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:13.883712 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f7b0ed15-de23-4f0c-bcaf-f9368da0935e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:13.884325 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f7b0ed15-de23-4f0c-bcaf-f9368da0935e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:13.891948 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f7b0ed15-de23-4f0c-bcaf-f9368da0935e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:13.892437 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f7b0ed15-de23-4f0c-bcaf-f9368da0935e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:13.893283 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f7b0ed15-de23-4f0c-bcaf-f9368da0935e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:13.893798 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f7b0ed15-de23-4f0c-bcaf-f9368da0935e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:13.966802 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-bec4d36e-b5cb-491a-9aa9-6f94eb830ef1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:13.967847 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-bec4d36e-b5cb-491a-9aa9-6f94eb830ef1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:13.974759 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bec4d36e-b5cb-491a-9aa9-6f94eb830ef1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:13.975608 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bec4d36e-b5cb-491a-9aa9-6f94eb830ef1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:13.976431 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bec4d36e-b5cb-491a-9aa9-6f94eb830ef1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:13.977006 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bec4d36e-b5cb-491a-9aa9-6f94eb830ef1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:14.034759 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f7b0ed15-de23-4f0c-bcaf-f9368da0935e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:14.042515 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f7b0ed15-de23-4f0c-bcaf-f9368da0935e tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1567 microversion: 2.1 time: 0.162520 Dec 20 09:32:14.043610 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 313/581] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:13 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:14.063988 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-bec4d36e-b5cb-491a-9aa9-6f94eb830ef1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.101518 Dec 20 09:32:14.064631 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 269/582] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:13 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:32:15.066014 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-124689c7-a38c-45b0-9882-3f2db1c5bea6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:15.066014 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-124689c7-a38c-45b0-9882-3f2db1c5bea6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:15.070088 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-124689c7-a38c-45b0-9882-3f2db1c5bea6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:15.070600 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-124689c7-a38c-45b0-9882-3f2db1c5bea6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:15.071597 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-124689c7-a38c-45b0-9882-3f2db1c5bea6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:15.072076 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-124689c7-a38c-45b0-9882-3f2db1c5bea6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:15.076076 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d03fcacb-5b83-4177-9218-e8fb14c7f7bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:15.077152 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d03fcacb-5b83-4177-9218-e8fb14c7f7bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:15.083747 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d03fcacb-5b83-4177-9218-e8fb14c7f7bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:15.084203 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d03fcacb-5b83-4177-9218-e8fb14c7f7bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:15.085018 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d03fcacb-5b83-4177-9218-e8fb14c7f7bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:15.085457 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d03fcacb-5b83-4177-9218-e8fb14c7f7bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:15.201189 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d03fcacb-5b83-4177-9218-e8fb14c7f7bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.129075 Dec 20 09:32:15.201835 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 270/583] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:15 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:32:15.202960 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-124689c7-a38c-45b0-9882-3f2db1c5bea6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:15.211331 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-124689c7-a38c-45b0-9882-3f2db1c5bea6 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1567 microversion: 2.1 time: 0.155674 Dec 20 09:32:15.215293 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 314/584] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:15 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:16.214684 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c945e469-eae0-4323-89b7-06dafa58ec52 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:16.215857 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c945e469-eae0-4323-89b7-06dafa58ec52 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:16.224389 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c945e469-eae0-4323-89b7-06dafa58ec52 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:16.224893 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c945e469-eae0-4323-89b7-06dafa58ec52 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:16.225690 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c945e469-eae0-4323-89b7-06dafa58ec52 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:16.226125 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c945e469-eae0-4323-89b7-06dafa58ec52 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:16.228438 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-604439ea-9c7b-49ea-b98e-e81c887fedb8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:16.229406 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-604439ea-9c7b-49ea-b98e-e81c887fedb8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:16.236410 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-604439ea-9c7b-49ea-b98e-e81c887fedb8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:16.240072 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-604439ea-9c7b-49ea-b98e-e81c887fedb8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:16.240072 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-604439ea-9c7b-49ea-b98e-e81c887fedb8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:16.240072 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-604439ea-9c7b-49ea-b98e-e81c887fedb8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:16.321302 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c945e469-eae0-4323-89b7-06dafa58ec52 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.111512 Dec 20 09:32:16.322325 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 271/585] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:16 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:32:16.371684 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-604439ea-9c7b-49ea-b98e-e81c887fedb8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:16.379901 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-604439ea-9c7b-49ea-b98e-e81c887fedb8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1567 microversion: 2.1 time: 0.155802 Dec 20 09:32:16.380491 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 315/586] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:16 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:17.225404 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-742e49fd-76d1-4539-9554-bd322d8548c0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92941e0d-fa7b-4b53-9bee-687292150d00"}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:17.226566 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-742e49fd-76d1-4539-9554-bd322d8548c0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:17.233366 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-742e49fd-76d1-4539-9554-bd322d8548c0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:17.233806 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-742e49fd-76d1-4539-9554-bd322d8548c0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:17.234567 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-742e49fd-76d1-4539-9554-bd322d8548c0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:17.235114 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-742e49fd-76d1-4539-9554-bd322d8548c0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:17.335426 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1997089e-f0bf-434d-944c-8516ad2e9b54 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:17.338733 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-1997089e-f0bf-434d-944c-8516ad2e9b54 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:17.345367 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-742e49fd-76d1-4539-9554-bd322d8548c0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] HTTP exception thrown: Invalid volume: volume 92941e0d-fa7b-4b53-9bee-687292150d00 is already attached to instances: 68a3fbd7-ef09-4f47-997e-918723eb5105 Dec 20 09:32:17.345812 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1997089e-f0bf-434d-944c-8516ad2e9b54 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:17.346255 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1997089e-f0bf-434d-944c-8516ad2e9b54 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:17.346596 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-742e49fd-76d1-4539-9554-bd322d8548c0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Returning 400 to user: Invalid volume: volume 92941e0d-fa7b-4b53-9bee-687292150d00 is already attached to instances: 68a3fbd7-ef09-4f47-997e-918723eb5105 {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:32:17.347214 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1997089e-f0bf-434d-944c-8516ad2e9b54 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:17.347643 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1997089e-f0bf-434d-944c-8516ad2e9b54 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:17.348125 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-742e49fd-76d1-4539-9554-bd322d8548c0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "POST /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.126833 Dec 20 09:32:17.349404 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 272/587] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 20 09:32:17 2021] POST /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105/os-volume_attachments => generated 174 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 20 09:32:17.411960 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9c15726a-ebba-45bf-adc1-486e91076fad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:17.411960 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9c15726a-ebba-45bf-adc1-486e91076fad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:17.411960 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9c15726a-ebba-45bf-adc1-486e91076fad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:17.411960 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9c15726a-ebba-45bf-adc1-486e91076fad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:17.412709 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9c15726a-ebba-45bf-adc1-486e91076fad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:17.412709 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9c15726a-ebba-45bf-adc1-486e91076fad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:17.463752 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1997089e-f0bf-434d-944c-8516ad2e9b54 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.134000 Dec 20 09:32:17.464528 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 316/588] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:17 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:17.469911 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-022023a7-8884-41a2-882e-51aaf029e856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:17.470640 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-022023a7-8884-41a2-882e-51aaf029e856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:17.477576 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-022023a7-8884-41a2-882e-51aaf029e856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:17.478143 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-022023a7-8884-41a2-882e-51aaf029e856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:17.479178 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-022023a7-8884-41a2-882e-51aaf029e856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:17.479872 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-022023a7-8884-41a2-882e-51aaf029e856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:17.567462 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.objects.instance [None req-022023a7-8884-41a2-882e-51aaf029e856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lazy-loading 'services' on Instance uuid 68a3fbd7-ef09-4f47-997e-918723eb5105 {{(pid=116674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:32:17.570502 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-9c15726a-ebba-45bf-adc1-486e91076fad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:17.578674 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9c15726a-ebba-45bf-adc1-486e91076fad tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1567 microversion: 2.1 time: 0.184773 Dec 20 09:32:17.588314 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 273/589] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:17 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:17.814938 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-022023a7-8884-41a2-882e-51aaf029e856 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "DELETE /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105/os-volume_attachments/92941e0d-fa7b-4b53-9bee-687292150d00" status: 202 len: 0 microversion: 2.1 time: 0.348738 Dec 20 09:32:17.818884 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 317/590] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 20 09:32:17 2021] DELETE /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105/os-volume_attachments/92941e0d-fa7b-4b53-9bee-687292150d00 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:17.824947 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2c7e6308-248b-4fd3-a25f-41bc1c9d6804 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:17.825915 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2c7e6308-248b-4fd3-a25f-41bc1c9d6804 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:17.832241 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2c7e6308-248b-4fd3-a25f-41bc1c9d6804 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:17.835020 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2c7e6308-248b-4fd3-a25f-41bc1c9d6804 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:17.835020 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2c7e6308-248b-4fd3-a25f-41bc1c9d6804 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:17.835020 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2c7e6308-248b-4fd3-a25f-41bc1c9d6804 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:17.866295 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2c7e6308-248b-4fd3-a25f-41bc1c9d6804 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046023 Dec 20 09:32:17.869232 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 274/591] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:32:17 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:32:18.475785 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-94957e2b-6e6d-4336-ae41-def46c719c28 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:18.476839 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-94957e2b-6e6d-4336-ae41-def46c719c28 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:18.484414 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-94957e2b-6e6d-4336-ae41-def46c719c28 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:18.485125 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-94957e2b-6e6d-4336-ae41-def46c719c28 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:18.486090 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-94957e2b-6e6d-4336-ae41-def46c719c28 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:18.486513 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-94957e2b-6e6d-4336-ae41-def46c719c28 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:18.561839 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-94957e2b-6e6d-4336-ae41-def46c719c28 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.089421 Dec 20 09:32:18.566321 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 318/592] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:18 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:18.596087 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d169b3e9-040f-4f4f-96a2-3f67e8dabb95 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:18.596685 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d169b3e9-040f-4f4f-96a2-3f67e8dabb95 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:18.603512 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d169b3e9-040f-4f4f-96a2-3f67e8dabb95 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:18.603985 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d169b3e9-040f-4f4f-96a2-3f67e8dabb95 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:18.605067 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d169b3e9-040f-4f4f-96a2-3f67e8dabb95 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:18.605667 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d169b3e9-040f-4f4f-96a2-3f67e8dabb95 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:18.753603 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d169b3e9-040f-4f4f-96a2-3f67e8dabb95 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:18.772276 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d169b3e9-040f-4f4f-96a2-3f67e8dabb95 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1567 microversion: 2.1 time: 0.169668 Dec 20 09:32:18.772276 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 275/593] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:18 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:18.878597 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-17bdd7ca-b178-41ea-8b3d-dcd1baba5c31 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:18.879616 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-17bdd7ca-b178-41ea-8b3d-dcd1baba5c31 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:18.886843 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-17bdd7ca-b178-41ea-8b3d-dcd1baba5c31 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:18.890172 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-17bdd7ca-b178-41ea-8b3d-dcd1baba5c31 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:18.890172 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-17bdd7ca-b178-41ea-8b3d-dcd1baba5c31 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:18.890172 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-17bdd7ca-b178-41ea-8b3d-dcd1baba5c31 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:18.921989 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-17bdd7ca-b178-41ea-8b3d-dcd1baba5c31 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047641 Dec 20 09:32:18.922553 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 319/594] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:32:18 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:32:19.573044 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f1c1a411-dc10-4eda-a656-943a135f75f7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:19.575953 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f1c1a411-dc10-4eda-a656-943a135f75f7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:19.580785 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f1c1a411-dc10-4eda-a656-943a135f75f7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:19.581234 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f1c1a411-dc10-4eda-a656-943a135f75f7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:19.582011 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f1c1a411-dc10-4eda-a656-943a135f75f7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:19.582446 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f1c1a411-dc10-4eda-a656-943a135f75f7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:19.652017 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f1c1a411-dc10-4eda-a656-943a135f75f7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.082489 Dec 20 09:32:19.653310 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 276/595] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:19 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:19.780095 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-946996d8-a1b5-4e3f-858f-ca4350665d85 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:19.780701 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-946996d8-a1b5-4e3f-858f-ca4350665d85 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:19.786875 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-946996d8-a1b5-4e3f-858f-ca4350665d85 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:19.787327 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-946996d8-a1b5-4e3f-858f-ca4350665d85 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:19.788135 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-946996d8-a1b5-4e3f-858f-ca4350665d85 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:19.788573 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-946996d8-a1b5-4e3f-858f-ca4350665d85 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:19.922143 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-946996d8-a1b5-4e3f-858f-ca4350665d85 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:19.929891 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-946996d8-a1b5-4e3f-858f-ca4350665d85 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1567 microversion: 2.1 time: 0.153387 Dec 20 09:32:19.930465 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 320/596] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:19 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:19.934410 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-bf516ae5-a075-4e7e-9018-32eca01e4182 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:19.936040 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-bf516ae5-a075-4e7e-9018-32eca01e4182 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:19.942643 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bf516ae5-a075-4e7e-9018-32eca01e4182 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:19.943089 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bf516ae5-a075-4e7e-9018-32eca01e4182 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:19.943919 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bf516ae5-a075-4e7e-9018-32eca01e4182 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:19.944351 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bf516ae5-a075-4e7e-9018-32eca01e4182 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:19.974664 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-bf516ae5-a075-4e7e-9018-32eca01e4182 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044816 Dec 20 09:32:19.975229 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 277/597] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:32:19 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 20 09:32:20.125142 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ba6efcb8-b381-47ad-9b18-4f093c8ed4e1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-314370111", "imageRef": "6f828f0b-c445-46a5-9960-492746785ef3", "flavorRef": "452", "networks": [{"uuid": "eda8d65d-a28a-4b39-afdf-98df1672c489"}]}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:20.176805 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.network.neutron [None req-ba6efcb8-b381-47ad-9b18-4f093c8ed4e1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] validate_networks() for [('eda8d65d-a28a-4b39-afdf-98df1672c489', None, None, None, None, None)] {{(pid=116674) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 09:32:20.556126 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-ba6efcb8-b381-47ad-9b18-4f093c8ed4e1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Flavor limits 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 09:32:20.556535 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-ba6efcb8-b381-47ad-9b18-4f093c8ed4e1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Image limits 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 09:32:20.557004 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-ba6efcb8-b381-47ad-9b18-4f093c8ed4e1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Flavor pref 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 09:32:20.557410 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-ba6efcb8-b381-47ad-9b18-4f093c8ed4e1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Image pref 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 09:32:20.557818 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-ba6efcb8-b381-47ad-9b18-4f093c8ed4e1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 09:32:20.566942 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ba6efcb8-b381-47ad-9b18-4f093c8ed4e1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:20.567462 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ba6efcb8-b381-47ad-9b18-4f093c8ed4e1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:20.568345 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ba6efcb8-b381-47ad-9b18-4f093c8ed4e1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:20.568787 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ba6efcb8-b381-47ad-9b18-4f093c8ed4e1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:20.586890 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-ba6efcb8-b381-47ad-9b18-4f093c8ed4e1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Getting quotas for project 24634d5b4d5a42479f08bfb638cdd78d. Resources: {'ram', 'cores', 'instances'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:32:20.591514 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-ba6efcb8-b381-47ad-9b18-4f093c8ed4e1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Getting quotas for user 10a6cc51b90e45d5a484e403dbbab488 and project 24634d5b4d5a42479f08bfb638cdd78d. Resources: {'ram', 'cores', 'instances'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:32:20.602341 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ba6efcb8-b381-47ad-9b18-4f093c8ed4e1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Going to run 1 instances... {{(pid=116674) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 09:32:20.604680 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ba6efcb8-b381-47ad-9b18-4f093c8ed4e1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f828f0b-c445-46a5-9960-492746785ef3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 09:32:20.663649 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-18ed8d7f-c726-45c6-b67f-9aa6f805e161 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:20.664524 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-18ed8d7f-c726-45c6-b67f-9aa6f805e161 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:20.670699 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-18ed8d7f-c726-45c6-b67f-9aa6f805e161 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:20.671146 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-18ed8d7f-c726-45c6-b67f-9aa6f805e161 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:20.671977 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-18ed8d7f-c726-45c6-b67f-9aa6f805e161 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:20.672387 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-18ed8d7f-c726-45c6-b67f-9aa6f805e161 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:20.745270 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-18ed8d7f-c726-45c6-b67f-9aa6f805e161 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.085173 Dec 20 09:32:20.746155 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 278/598] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:20 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:32:20.805195 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ba6efcb8-b381-47ad-9b18-4f093c8ed4e1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.684168 Dec 20 09:32:20.806642 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 321/599] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 20 09:32:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 09:32:20.820474 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4a002b70-cfc1-4195-9a58-7acdcdddc67f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:20.821261 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4a002b70-cfc1-4195-9a58-7acdcdddc67f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:20.883551 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-4a002b70-cfc1-4195-9a58-7acdcdddc67f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:20.890719 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4a002b70-cfc1-4195-9a58-7acdcdddc67f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1217 microversion: 2.1 time: 0.076273 Dec 20 09:32:20.895796 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 279/600] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:20 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:20.947335 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-de0a793e-7a56-43f4-b81c-93af87f58003 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:20.947985 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-de0a793e-7a56-43f4-b81c-93af87f58003 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:20.955579 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-de0a793e-7a56-43f4-b81c-93af87f58003 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:20.956049 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-de0a793e-7a56-43f4-b81c-93af87f58003 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:20.956833 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-de0a793e-7a56-43f4-b81c-93af87f58003 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:20.957268 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-de0a793e-7a56-43f4-b81c-93af87f58003 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:21.087646 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-de0a793e-7a56-43f4-b81c-93af87f58003 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:21.095856 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-de0a793e-7a56-43f4-b81c-93af87f58003 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1567 microversion: 2.1 time: 0.152536 Dec 20 09:32:21.096422 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 322/601] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:20 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:21.546659 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-fdcd536b-e1b9-4dc7-add2-f13e1eea0e8f tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2023232643", "imageRef": "6f828f0b-c445-46a5-9960-492746785ef3", "flavorRef": "452"}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:21.603863 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.network.neutron [None req-fdcd536b-e1b9-4dc7-add2-f13e1eea0e8f tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] validate_networks() for None {{(pid=116675) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 09:32:21.756926 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d0c48e1d-0571-479a-aca6-da4c906a073f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:21.757943 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d0c48e1d-0571-479a-aca6-da4c906a073f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:21.770456 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d0c48e1d-0571-479a-aca6-da4c906a073f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:21.770985 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d0c48e1d-0571-479a-aca6-da4c906a073f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:21.771637 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d0c48e1d-0571-479a-aca6-da4c906a073f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:21.772291 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d0c48e1d-0571-479a-aca6-da4c906a073f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:21.850609 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d0c48e1d-0571-479a-aca6-da4c906a073f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.096970 Dec 20 09:32:21.856229 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 323/602] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:21 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:32:21.912099 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1cffadb6-61e1-429e-a513-ab5adecb6747 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:21.912814 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-1cffadb6-61e1-429e-a513-ab5adecb6747 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:21.920717 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1cffadb6-61e1-429e-a513-ab5adecb6747 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:21.921364 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1cffadb6-61e1-429e-a513-ab5adecb6747 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:21.922163 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1cffadb6-61e1-429e-a513-ab5adecb6747 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:21.922703 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1cffadb6-61e1-429e-a513-ab5adecb6747 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:22.016668 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1cffadb6-61e1-429e-a513-ab5adecb6747 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:22.025410 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1cffadb6-61e1-429e-a513-ab5adecb6747 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1221 microversion: 2.1 time: 0.120877 Dec 20 09:32:22.034574 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 324/603] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:21 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1221 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:22.113118 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8d1b4546-054b-42ef-ac93-f1d16d40d5e5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:22.113732 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-8d1b4546-054b-42ef-ac93-f1d16d40d5e5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:22.115024 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-fdcd536b-e1b9-4dc7-add2-f13e1eea0e8f tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Flavor limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 09:32:22.115502 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-fdcd536b-e1b9-4dc7-add2-f13e1eea0e8f tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Image limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 09:32:22.115953 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-fdcd536b-e1b9-4dc7-add2-f13e1eea0e8f tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Flavor pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 09:32:22.116363 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-fdcd536b-e1b9-4dc7-add2-f13e1eea0e8f tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Image pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 09:32:22.116769 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-fdcd536b-e1b9-4dc7-add2-f13e1eea0e8f tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 09:32:22.120473 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8d1b4546-054b-42ef-ac93-f1d16d40d5e5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:22.121088 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8d1b4546-054b-42ef-ac93-f1d16d40d5e5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:22.121817 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8d1b4546-054b-42ef-ac93-f1d16d40d5e5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:22.122258 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8d1b4546-054b-42ef-ac93-f1d16d40d5e5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:22.126606 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fdcd536b-e1b9-4dc7-add2-f13e1eea0e8f tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:22.127053 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fdcd536b-e1b9-4dc7-add2-f13e1eea0e8f tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:22.127932 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fdcd536b-e1b9-4dc7-add2-f13e1eea0e8f tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:22.128366 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fdcd536b-e1b9-4dc7-add2-f13e1eea0e8f tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:22.144589 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-fdcd536b-e1b9-4dc7-add2-f13e1eea0e8f tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Getting quotas for project df8c7a53cc0b4395b6360b5b19a1b9cb. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:32:22.148584 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-fdcd536b-e1b9-4dc7-add2-f13e1eea0e8f tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Getting quotas for user a1a7b3f4b8e54097a66d816d7f2ff8a6 and project df8c7a53cc0b4395b6360b5b19a1b9cb. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:32:22.159733 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-fdcd536b-e1b9-4dc7-add2-f13e1eea0e8f tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Going to run 1 instances... {{(pid=116675) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 09:32:22.162070 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-fdcd536b-e1b9-4dc7-add2-f13e1eea0e8f tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f828f0b-c445-46a5-9960-492746785ef3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 09:32:22.267338 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-fdcd536b-e1b9-4dc7-add2-f13e1eea0e8f tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.724385 Dec 20 09:32:22.268874 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 280/604] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 20 09:32:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 09:32:22.279525 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-8d1b4546-054b-42ef-ac93-f1d16d40d5e5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:22.289698 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2be70980-58f1-4281-91e2-52309ee10b31 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:22.291212 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2be70980-58f1-4281-91e2-52309ee10b31 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:22.294860 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8d1b4546-054b-42ef-ac93-f1d16d40d5e5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1567 microversion: 2.1 time: 0.185356 Dec 20 09:32:22.297239 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 325/605] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:22 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:22.349415 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-2be70980-58f1-4281-91e2-52309ee10b31 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a7b3f4b8e54097a66d816d7f2ff8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c7a53cc0b4395b6360b5b19a1b9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:22.356869 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2be70980-58f1-4281-91e2-52309ee10b31 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 200 len: 1215 microversion: 2.1 time: 0.080603 Dec 20 09:32:22.357426 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 281/606] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:22 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:22.862459 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4e70af1e-ba53-4c7d-b59f-2bf96cea76ac tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:22.864005 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-4e70af1e-ba53-4c7d-b59f-2bf96cea76ac tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:22.870365 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4e70af1e-ba53-4c7d-b59f-2bf96cea76ac tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:22.870804 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4e70af1e-ba53-4c7d-b59f-2bf96cea76ac tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:22.871584 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4e70af1e-ba53-4c7d-b59f-2bf96cea76ac tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:22.872045 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4e70af1e-ba53-4c7d-b59f-2bf96cea76ac tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:22.953109 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-4e70af1e-ba53-4c7d-b59f-2bf96cea76ac tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.093529 Dec 20 09:32:22.954003 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 326/607] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:22 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:32:23.042126 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-393f9628-3928-45c4-b280-455fd685c760 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:23.043081 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-393f9628-3928-45c4-b280-455fd685c760 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:23.052717 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-393f9628-3928-45c4-b280-455fd685c760 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:23.063927 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-393f9628-3928-45c4-b280-455fd685c760 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:23.065093 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-393f9628-3928-45c4-b280-455fd685c760 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:23.067078 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-393f9628-3928-45c4-b280-455fd685c760 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:23.174781 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-393f9628-3928-45c4-b280-455fd685c760 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:23.182652 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-393f9628-3928-45c4-b280-455fd685c760 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1277 microversion: 2.1 time: 0.144185 Dec 20 09:32:23.183345 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 282/608] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:23 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1277 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:23.313909 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-2d419dfd-8f0c-4273-bc92-14479023da7a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:23.314908 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-2d419dfd-8f0c-4273-bc92-14479023da7a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:23.322698 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2d419dfd-8f0c-4273-bc92-14479023da7a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:23.323144 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2d419dfd-8f0c-4273-bc92-14479023da7a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:23.323971 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2d419dfd-8f0c-4273-bc92-14479023da7a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:23.324409 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2d419dfd-8f0c-4273-bc92-14479023da7a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:23.373201 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2eee712c-308b-4ef0-af3a-661567967d63 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:23.373811 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2eee712c-308b-4ef0-af3a-661567967d63 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:23.440462 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-2eee712c-308b-4ef0-af3a-661567967d63 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a7b3f4b8e54097a66d816d7f2ff8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c7a53cc0b4395b6360b5b19a1b9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:23.449070 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2eee712c-308b-4ef0-af3a-661567967d63 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 200 len: 1215 microversion: 2.1 time: 0.079438 Dec 20 09:32:23.449647 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 283/609] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:23 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 1215 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:23.476269 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-2d419dfd-8f0c-4273-bc92-14479023da7a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:23.484822 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-2d419dfd-8f0c-4273-bc92-14479023da7a tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1567 microversion: 2.1 time: 0.175050 Dec 20 09:32:23.486583 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 327/610] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:23 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:23.965067 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-daf378cc-f48f-45a5-a79d-02d3ac9fc1c6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:23.966042 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-daf378cc-f48f-45a5-a79d-02d3ac9fc1c6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:23.972026 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-daf378cc-f48f-45a5-a79d-02d3ac9fc1c6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:23.972466 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-daf378cc-f48f-45a5-a79d-02d3ac9fc1c6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:23.973415 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-daf378cc-f48f-45a5-a79d-02d3ac9fc1c6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:23.973843 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-daf378cc-f48f-45a5-a79d-02d3ac9fc1c6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:24.074787 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-daf378cc-f48f-45a5-a79d-02d3ac9fc1c6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.113265 Dec 20 09:32:24.075718 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 284/611] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:23 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:24.200614 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-39bbb8ba-d75b-46b5-b88e-7710d99011eb tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:24.201225 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-39bbb8ba-d75b-46b5-b88e-7710d99011eb tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:24.212985 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-39bbb8ba-d75b-46b5-b88e-7710d99011eb tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:24.214542 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-39bbb8ba-d75b-46b5-b88e-7710d99011eb tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:24.217279 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-39bbb8ba-d75b-46b5-b88e-7710d99011eb tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:24.217756 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-39bbb8ba-d75b-46b5-b88e-7710d99011eb tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:24.300909 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-39bbb8ba-d75b-46b5-b88e-7710d99011eb tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:24.309274 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-39bbb8ba-d75b-46b5-b88e-7710d99011eb tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1275 microversion: 2.1 time: 0.113395 Dec 20 09:32:24.309856 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 328/612] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:24 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1275 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:24.472042 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8d9cef70-2bb0-4947-a57e-b81c9440083a tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:24.473568 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8d9cef70-2bb0-4947-a57e-b81c9440083a tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:24.482881 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8d9cef70-2bb0-4947-a57e-b81c9440083a tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:24.483355 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8d9cef70-2bb0-4947-a57e-b81c9440083a tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:24.484209 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8d9cef70-2bb0-4947-a57e-b81c9440083a tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:24.484638 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8d9cef70-2bb0-4947-a57e-b81c9440083a tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:24.519042 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-63fd0d30-24eb-4d71-a522-9b243f05f416 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:24.520266 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-63fd0d30-24eb-4d71-a522-9b243f05f416 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:24.541769 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-63fd0d30-24eb-4d71-a522-9b243f05f416 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:24.543845 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-63fd0d30-24eb-4d71-a522-9b243f05f416 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:24.545210 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-63fd0d30-24eb-4d71-a522-9b243f05f416 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:24.550568 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-63fd0d30-24eb-4d71-a522-9b243f05f416 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:24.594683 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8d9cef70-2bb0-4947-a57e-b81c9440083a tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a7b3f4b8e54097a66d816d7f2ff8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c7a53cc0b4395b6360b5b19a1b9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:24.603646 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8d9cef70-2bb0-4947-a57e-b81c9440083a tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 200 len: 1267 microversion: 2.1 time: 0.136646 Dec 20 09:32:24.604332 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 285/613] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:24 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:24.839493 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-63fd0d30-24eb-4d71-a522-9b243f05f416 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:24.851332 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-63fd0d30-24eb-4d71-a522-9b243f05f416 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1567 microversion: 2.1 time: 0.342329 Dec 20 09:32:24.852457 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 329/614] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:24 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1567 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:25.092499 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c325f81d-83b8-41c4-be25-0cc2f1b041c6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:25.093459 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c325f81d-83b8-41c4-be25-0cc2f1b041c6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:25.110776 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c325f81d-83b8-41c4-be25-0cc2f1b041c6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:25.111231 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c325f81d-83b8-41c4-be25-0cc2f1b041c6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:25.112058 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c325f81d-83b8-41c4-be25-0cc2f1b041c6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:25.112496 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c325f81d-83b8-41c4-be25-0cc2f1b041c6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:25.326376 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-45e5ef6a-ba5f-4445-8467-7af38d354914 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:25.327616 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-45e5ef6a-ba5f-4445-8467-7af38d354914 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:25.333912 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-45e5ef6a-ba5f-4445-8467-7af38d354914 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:25.334359 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-45e5ef6a-ba5f-4445-8467-7af38d354914 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:25.335149 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-45e5ef6a-ba5f-4445-8467-7af38d354914 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:25.335587 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-45e5ef6a-ba5f-4445-8467-7af38d354914 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:25.359083 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c325f81d-83b8-41c4-be25-0cc2f1b041c6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.269360 Dec 20 09:32:25.359775 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 286/615] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:25 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:25.484448 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-45e5ef6a-ba5f-4445-8467-7af38d354914 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:25.492679 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-45e5ef6a-ba5f-4445-8467-7af38d354914 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1317 microversion: 2.1 time: 0.169934 Dec 20 09:32:25.493434 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 330/616] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:25 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:25.623047 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-018c273d-6642-4867-b1bb-5aff2742f7a3 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:25.623968 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-018c273d-6642-4867-b1bb-5aff2742f7a3 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:25.633946 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-018c273d-6642-4867-b1bb-5aff2742f7a3 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:25.639443 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-018c273d-6642-4867-b1bb-5aff2742f7a3 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:25.646439 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-018c273d-6642-4867-b1bb-5aff2742f7a3 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:25.646992 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-018c273d-6642-4867-b1bb-5aff2742f7a3 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:25.727578 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-018c273d-6642-4867-b1bb-5aff2742f7a3 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a7b3f4b8e54097a66d816d7f2ff8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c7a53cc0b4395b6360b5b19a1b9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:25.737133 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-018c273d-6642-4867-b1bb-5aff2742f7a3 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 200 len: 1285 microversion: 2.1 time: 0.119846 Dec 20 09:32:25.759535 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 287/617] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:25 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 1285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:25.878172 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a4b4caba-e5e0-4a2c-8c0d-398d21219bf8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:25.878698 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a4b4caba-e5e0-4a2c-8c0d-398d21219bf8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:25.884489 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a4b4caba-e5e0-4a2c-8c0d-398d21219bf8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:25.884939 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a4b4caba-e5e0-4a2c-8c0d-398d21219bf8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:25.885722 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a4b4caba-e5e0-4a2c-8c0d-398d21219bf8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:25.886160 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a4b4caba-e5e0-4a2c-8c0d-398d21219bf8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:26.024056 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-4b029f4e-cdc6-4d83-b817-5e872794ff8b req-ef248a02-920d-4a44-bf8f-2521074e04eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "399b91a8-a248-4272-806a-cbfb84e66313", "tag": "f9f613bc-e935-42ad-9672-010d478a8336"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:26.026298 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:32:26.026298 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:32:26.039327 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-4b029f4e-cdc6-4d83-b817-5e872794ff8b req-ef248a02-920d-4a44-bf8f-2521074e04eb service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:26.039917 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-4b029f4e-cdc6-4d83-b817-5e872794ff8b req-ef248a02-920d-4a44-bf8f-2521074e04eb service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:26.052272 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-4b029f4e-cdc6-4d83-b817-5e872794ff8b req-ef248a02-920d-4a44-bf8f-2521074e04eb service nova] Creating event network-changed:f9f613bc-e935-42ad-9672-010d478a8336 for instance 399b91a8-a248-4272-806a-cbfb84e66313 on hv-cinder-81908 Dec 20 09:32:26.057087 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-4b029f4e-cdc6-4d83-b817-5e872794ff8b req-ef248a02-920d-4a44-bf8f-2521074e04eb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037204 Dec 20 09:32:26.057683 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 288/618] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:32:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:32:26.181490 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a4b4caba-e5e0-4a2c-8c0d-398d21219bf8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:26.190403 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a4b4caba-e5e0-4a2c-8c0d-398d21219bf8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1547 microversion: 2.1 time: 0.316614 Dec 20 09:32:26.191219 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 331/619] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:25 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1547 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:26.207506 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ccdf77ad-8064-4f2d-8841-719e2af1e980 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:26.208120 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ccdf77ad-8064-4f2d-8841-719e2af1e980 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:26.214701 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ccdf77ad-8064-4f2d-8841-719e2af1e980 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:26.215141 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ccdf77ad-8064-4f2d-8841-719e2af1e980 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:26.215980 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ccdf77ad-8064-4f2d-8841-719e2af1e980 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:26.216390 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ccdf77ad-8064-4f2d-8841-719e2af1e980 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:26.361717 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-ccdf77ad-8064-4f2d-8841-719e2af1e980 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] HTTP exception thrown: Cannot 'detach_volume' instance 1af8e934-5860-485f-abf5-42a2814d66e7 while it is in vm_state rescued Dec 20 09:32:26.362307 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ccdf77ad-8064-4f2d-8841-719e2af1e980 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Returning 409 to user: Cannot 'detach_volume' instance 1af8e934-5860-485f-abf5-42a2814d66e7 while it is in vm_state rescued {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:32:26.363314 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ccdf77ad-8064-4f2d-8841-719e2af1e980 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7/os-volume_attachments/6d41b8a8-fcf1-4e69-b3c7-bc50e0469f7c" status: 409 len: 152 microversion: 2.1 time: 0.159907 Dec 20 09:32:26.364046 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 289/620] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 20 09:32:26 2021] DELETE /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7/os-volume_attachments/6d41b8a8-fcf1-4e69-b3c7-bc50e0469f7c => generated 152 bytes in 162 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 20 09:32:26.375320 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9dbc8334-fa64-473c-8eb5-38211c8eb6e0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:26.375862 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9dbc8334-fa64-473c-8eb5-38211c8eb6e0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:26.377962 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-2fb1ac3c-c067-47ab-93e1-7b0747669051 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:26.381913 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-2fb1ac3c-c067-47ab-93e1-7b0747669051 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:26.383714 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9dbc8334-fa64-473c-8eb5-38211c8eb6e0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:26.384378 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9dbc8334-fa64-473c-8eb5-38211c8eb6e0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:26.385502 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9dbc8334-fa64-473c-8eb5-38211c8eb6e0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:26.386128 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9dbc8334-fa64-473c-8eb5-38211c8eb6e0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:26.388101 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2fb1ac3c-c067-47ab-93e1-7b0747669051 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:26.388676 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2fb1ac3c-c067-47ab-93e1-7b0747669051 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:26.390038 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2fb1ac3c-c067-47ab-93e1-7b0747669051 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:26.390607 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2fb1ac3c-c067-47ab-93e1-7b0747669051 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:26.472549 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-2fb1ac3c-c067-47ab-93e1-7b0747669051 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.101521 Dec 20 09:32:26.475713 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 332/621] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:26 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:26.511345 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-706043de-f913-4fc4-8c1d-03a6250668a9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:26.513457 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-706043de-f913-4fc4-8c1d-03a6250668a9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:26.521951 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-706043de-f913-4fc4-8c1d-03a6250668a9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:26.524012 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-706043de-f913-4fc4-8c1d-03a6250668a9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:26.524867 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-706043de-f913-4fc4-8c1d-03a6250668a9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:26.525312 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-706043de-f913-4fc4-8c1d-03a6250668a9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:26.616902 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9dbc8334-fa64-473c-8eb5-38211c8eb6e0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "POST /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7/action" status: 202 len: 0 microversion: 2.1 time: 0.246001 Dec 20 09:32:26.619394 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 290/622] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:32:26 2021] POST /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:26.626680 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6045ec88-8565-4804-9efe-5530de114ca0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:26.628075 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6045ec88-8565-4804-9efe-5530de114ca0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:26.637039 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6045ec88-8565-4804-9efe-5530de114ca0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:26.637497 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6045ec88-8565-4804-9efe-5530de114ca0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:26.638284 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6045ec88-8565-4804-9efe-5530de114ca0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:26.638738 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6045ec88-8565-4804-9efe-5530de114ca0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:26.777078 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-706043de-f913-4fc4-8c1d-03a6250668a9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:26.792906 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-706043de-f913-4fc4-8c1d-03a6250668a9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1317 microversion: 2.1 time: 0.286879 Dec 20 09:32:26.795708 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 333/623] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:26 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:26.800919 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d796ce6c-2886-4e8e-9a98-a770c2196f7c tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:26.801610 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d796ce6c-2886-4e8e-9a98-a770c2196f7c tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:26.814059 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d796ce6c-2886-4e8e-9a98-a770c2196f7c tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:26.814059 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d796ce6c-2886-4e8e-9a98-a770c2196f7c tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:26.814059 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d796ce6c-2886-4e8e-9a98-a770c2196f7c tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:26.814059 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d796ce6c-2886-4e8e-9a98-a770c2196f7c tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:26.930856 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6045ec88-8565-4804-9efe-5530de114ca0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:26.946591 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6045ec88-8565-4804-9efe-5530de114ca0 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1555 microversion: 2.1 time: 0.324568 Dec 20 09:32:26.958303 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 291/624] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:26 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1555 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:27.105207 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d796ce6c-2886-4e8e-9a98-a770c2196f7c tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a7b3f4b8e54097a66d816d7f2ff8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c7a53cc0b4395b6360b5b19a1b9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:27.113701 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d796ce6c-2886-4e8e-9a98-a770c2196f7c tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 200 len: 1315 microversion: 2.1 time: 0.317849 Dec 20 09:32:27.123689 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 334/625] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:26 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:27.484608 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6334ef1c-ee88-40e3-8c75-fea9a78c0381 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:27.485586 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6334ef1c-ee88-40e3-8c75-fea9a78c0381 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:27.503563 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6334ef1c-ee88-40e3-8c75-fea9a78c0381 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:27.504050 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6334ef1c-ee88-40e3-8c75-fea9a78c0381 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:27.504840 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6334ef1c-ee88-40e3-8c75-fea9a78c0381 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:27.505275 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6334ef1c-ee88-40e3-8c75-fea9a78c0381 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:27.809797 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ceb1751b-a1f5-4702-b397-7f2f9da6560a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:27.811915 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ceb1751b-a1f5-4702-b397-7f2f9da6560a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:27.820712 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ceb1751b-a1f5-4702-b397-7f2f9da6560a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:27.824232 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ceb1751b-a1f5-4702-b397-7f2f9da6560a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:27.824232 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ceb1751b-a1f5-4702-b397-7f2f9da6560a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:27.824232 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ceb1751b-a1f5-4702-b397-7f2f9da6560a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:27.975977 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ceb1751b-a1f5-4702-b397-7f2f9da6560a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:27.983988 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ceb1751b-a1f5-4702-b397-7f2f9da6560a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1317 microversion: 2.1 time: 0.177736 Dec 20 09:32:27.984555 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 335/626] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:27 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:27.993605 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-95acfc2b-3baa-4ca3-b76b-ee318e20243c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:27.994201 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-95acfc2b-3baa-4ca3-b76b-ee318e20243c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:28.001027 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-95acfc2b-3baa-4ca3-b76b-ee318e20243c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:28.005292 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-95acfc2b-3baa-4ca3-b76b-ee318e20243c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:28.006168 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-95acfc2b-3baa-4ca3-b76b-ee318e20243c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:28.006612 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-95acfc2b-3baa-4ca3-b76b-ee318e20243c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:28.084577 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6334ef1c-ee88-40e3-8c75-fea9a78c0381 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.603899 Dec 20 09:32:28.088398 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 292/627] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:27 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:28.109602 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-8787d62f-43e6-4921-92c3-cf043d511d45 req-b45f0ecc-09f7-4c31-832d-e5534f746824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae746f86-e246-49b6-93f3-71da2dd1967b", "tag": "038f6aed-163b-4433-8b88-e61fcbb2194a"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:28.111091 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:32:28.111091 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:32:28.131177 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-8787d62f-43e6-4921-92c3-cf043d511d45 req-b45f0ecc-09f7-4c31-832d-e5534f746824 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:28.131648 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-8787d62f-43e6-4921-92c3-cf043d511d45 req-b45f0ecc-09f7-4c31-832d-e5534f746824 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:28.147136 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-8787d62f-43e6-4921-92c3-cf043d511d45 req-b45f0ecc-09f7-4c31-832d-e5534f746824 service nova] Creating event network-changed:038f6aed-163b-4433-8b88-e61fcbb2194a for instance ae746f86-e246-49b6-93f3-71da2dd1967b on hv-cinder-81908 Dec 20 09:32:28.153517 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-8787d62f-43e6-4921-92c3-cf043d511d45 req-b45f0ecc-09f7-4c31-832d-e5534f746824 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047846 Dec 20 09:32:28.157984 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 293/628] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:32:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:32:28.163421 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2619406c-043b-41f8-93d6-6e748bb455d6 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:28.164150 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-95acfc2b-3baa-4ca3-b76b-ee318e20243c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:28.164329 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2619406c-043b-41f8-93d6-6e748bb455d6 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:28.172873 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2619406c-043b-41f8-93d6-6e748bb455d6 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:28.173501 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2619406c-043b-41f8-93d6-6e748bb455d6 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:28.173920 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-95acfc2b-3baa-4ca3-b76b-ee318e20243c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1555 microversion: 2.1 time: 0.183788 Dec 20 09:32:28.174642 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 336/629] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:27 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1555 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:28.175110 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2619406c-043b-41f8-93d6-6e748bb455d6 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:28.175636 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2619406c-043b-41f8-93d6-6e748bb455d6 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:28.332957 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-2619406c-043b-41f8-93d6-6e748bb455d6 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a7b3f4b8e54097a66d816d7f2ff8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c7a53cc0b4395b6360b5b19a1b9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:28.340848 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2619406c-043b-41f8-93d6-6e748bb455d6 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 200 len: 1315 microversion: 2.1 time: 0.181552 Dec 20 09:32:28.341538 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 294/630] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:28 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:29.000729 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-718f58df-bc56-469a-b99c-e35881930aa1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:29.001268 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-718f58df-bc56-469a-b99c-e35881930aa1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:29.007439 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-718f58df-bc56-469a-b99c-e35881930aa1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:29.007930 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-718f58df-bc56-469a-b99c-e35881930aa1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:29.008724 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-718f58df-bc56-469a-b99c-e35881930aa1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:29.009199 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-718f58df-bc56-469a-b99c-e35881930aa1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:29.096749 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f34771d7-6a3f-496f-8e67-b491b8bced8f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:29.097755 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f34771d7-6a3f-496f-8e67-b491b8bced8f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:29.104111 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f34771d7-6a3f-496f-8e67-b491b8bced8f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:29.104554 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f34771d7-6a3f-496f-8e67-b491b8bced8f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:29.105320 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f34771d7-6a3f-496f-8e67-b491b8bced8f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:29.105744 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f34771d7-6a3f-496f-8e67-b491b8bced8f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:29.141079 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-718f58df-bc56-469a-b99c-e35881930aa1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:29.148539 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-718f58df-bc56-469a-b99c-e35881930aa1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1317 microversion: 2.1 time: 0.151886 Dec 20 09:32:29.149106 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 337/631] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:28 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:29.191617 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b97fc09c-b8c3-475e-9480-3bc6cbd683a7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:29.192240 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b97fc09c-b8c3-475e-9480-3bc6cbd683a7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:29.197923 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b97fc09c-b8c3-475e-9480-3bc6cbd683a7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:29.198360 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b97fc09c-b8c3-475e-9480-3bc6cbd683a7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:29.199127 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b97fc09c-b8c3-475e-9480-3bc6cbd683a7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:29.199553 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b97fc09c-b8c3-475e-9480-3bc6cbd683a7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:29.332102 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b97fc09c-b8c3-475e-9480-3bc6cbd683a7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:29.340524 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b97fc09c-b8c3-475e-9480-3bc6cbd683a7 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1555 microversion: 2.1 time: 0.152573 Dec 20 09:32:29.341081 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 338/632] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:29 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:29.357414 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1df13999-6736-4519-89ae-50f969fbeaa5 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:29.358128 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-1df13999-6736-4519-89ae-50f969fbeaa5 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:29.365816 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1df13999-6736-4519-89ae-50f969fbeaa5 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:29.366346 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1df13999-6736-4519-89ae-50f969fbeaa5 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:29.367339 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1df13999-6736-4519-89ae-50f969fbeaa5 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:29.368032 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1df13999-6736-4519-89ae-50f969fbeaa5 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:29.716848 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1df13999-6736-4519-89ae-50f969fbeaa5 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a7b3f4b8e54097a66d816d7f2ff8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c7a53cc0b4395b6360b5b19a1b9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:29.724028 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1df13999-6736-4519-89ae-50f969fbeaa5 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 200 len: 1315 microversion: 2.1 time: 0.370287 Dec 20 09:32:29.724604 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 339/633] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:29 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:29.860979 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f34771d7-6a3f-496f-8e67-b491b8bced8f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.768376 Dec 20 09:32:29.861619 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 295/634] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:29 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:32:30.164876 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-78c386b5-1260-4216-b27a-74c5e854f9cf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:30.165492 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-78c386b5-1260-4216-b27a-74c5e854f9cf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:30.172596 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-78c386b5-1260-4216-b27a-74c5e854f9cf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:30.173046 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-78c386b5-1260-4216-b27a-74c5e854f9cf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:30.173835 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-78c386b5-1260-4216-b27a-74c5e854f9cf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:30.174272 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-78c386b5-1260-4216-b27a-74c5e854f9cf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:30.304665 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-78c386b5-1260-4216-b27a-74c5e854f9cf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:30.312081 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-78c386b5-1260-4216-b27a-74c5e854f9cf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1317 microversion: 2.1 time: 0.150668 Dec 20 09:32:30.312712 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 340/635] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:30 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:30.357352 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-433deff7-2c94-47c8-9590-4990dd25ddc9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:30.358056 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-433deff7-2c94-47c8-9590-4990dd25ddc9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:30.365692 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-433deff7-2c94-47c8-9590-4990dd25ddc9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:30.366151 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-433deff7-2c94-47c8-9590-4990dd25ddc9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:30.366966 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-433deff7-2c94-47c8-9590-4990dd25ddc9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:30.367402 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-433deff7-2c94-47c8-9590-4990dd25ddc9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:30.496173 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-433deff7-2c94-47c8-9590-4990dd25ddc9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:30.504725 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-433deff7-2c94-47c8-9590-4990dd25ddc9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1555 microversion: 2.1 time: 0.151320 Dec 20 09:32:30.505297 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 296/636] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:30 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:30.740801 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e44123c7-c6b8-4e8d-b543-fa79b37493af tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:30.741417 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e44123c7-c6b8-4e8d-b543-fa79b37493af tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:30.747076 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e44123c7-c6b8-4e8d-b543-fa79b37493af tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:30.747525 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e44123c7-c6b8-4e8d-b543-fa79b37493af tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:30.748333 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e44123c7-c6b8-4e8d-b543-fa79b37493af tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:30.748772 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e44123c7-c6b8-4e8d-b543-fa79b37493af tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:30.875325 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-7e45a557-9379-4bb8-9e97-47b2215964e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:30.879271 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-7e45a557-9379-4bb8-9e97-47b2215964e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:30.884560 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e44123c7-c6b8-4e8d-b543-fa79b37493af tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a7b3f4b8e54097a66d816d7f2ff8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c7a53cc0b4395b6360b5b19a1b9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:30.887195 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7e45a557-9379-4bb8-9e97-47b2215964e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:30.887776 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7e45a557-9379-4bb8-9e97-47b2215964e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:30.888733 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7e45a557-9379-4bb8-9e97-47b2215964e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:30.889331 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7e45a557-9379-4bb8-9e97-47b2215964e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:30.895241 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e44123c7-c6b8-4e8d-b543-fa79b37493af tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 200 len: 1315 microversion: 2.1 time: 0.157942 Dec 20 09:32:30.897728 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 341/637] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:30 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:31.157357 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-7e45a557-9379-4bb8-9e97-47b2215964e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.289366 Dec 20 09:32:31.158006 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 297/638] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:30 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:31.329038 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-488f6849-2898-4811-b051-d930c44f2c71 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:31.329632 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-488f6849-2898-4811-b051-d930c44f2c71 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:31.336092 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-488f6849-2898-4811-b051-d930c44f2c71 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:31.336537 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-488f6849-2898-4811-b051-d930c44f2c71 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:31.337310 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-488f6849-2898-4811-b051-d930c44f2c71 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:31.337739 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-488f6849-2898-4811-b051-d930c44f2c71 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:31.470513 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-488f6849-2898-4811-b051-d930c44f2c71 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:31.478080 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-488f6849-2898-4811-b051-d930c44f2c71 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1317 microversion: 2.1 time: 0.153259 Dec 20 09:32:31.478921 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 342/639] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:31 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:31.521590 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4e857765-67e4-433c-bea5-c178fbae4210 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:31.522299 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4e857765-67e4-433c-bea5-c178fbae4210 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:31.529287 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4e857765-67e4-433c-bea5-c178fbae4210 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:31.529740 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4e857765-67e4-433c-bea5-c178fbae4210 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:31.530515 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4e857765-67e4-433c-bea5-c178fbae4210 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:31.530952 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4e857765-67e4-433c-bea5-c178fbae4210 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:31.664972 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-4e857765-67e4-433c-bea5-c178fbae4210 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:31.673379 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4e857765-67e4-433c-bea5-c178fbae4210 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1555 microversion: 2.1 time: 0.155819 Dec 20 09:32:31.673940 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 298/640] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:31 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:31.915190 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0e62ffc8-a658-4fef-8328-211ae3bd366e tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:31.915742 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0e62ffc8-a658-4fef-8328-211ae3bd366e tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:31.922310 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0e62ffc8-a658-4fef-8328-211ae3bd366e tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:31.922761 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0e62ffc8-a658-4fef-8328-211ae3bd366e tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:31.923556 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0e62ffc8-a658-4fef-8328-211ae3bd366e tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:31.924020 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0e62ffc8-a658-4fef-8328-211ae3bd366e tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:32.049270 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-0e62ffc8-a658-4fef-8328-211ae3bd366e tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a7b3f4b8e54097a66d816d7f2ff8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c7a53cc0b4395b6360b5b19a1b9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:32.056408 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0e62ffc8-a658-4fef-8328-211ae3bd366e tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 200 len: 1315 microversion: 2.1 time: 0.145059 Dec 20 09:32:32.056974 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 343/641] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:31 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:32.169240 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9c6ad473-7849-4eb4-9b9d-3e40a9d17e8f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:32.170084 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9c6ad473-7849-4eb4-9b9d-3e40a9d17e8f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:32.176369 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9c6ad473-7849-4eb4-9b9d-3e40a9d17e8f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:32.176814 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9c6ad473-7849-4eb4-9b9d-3e40a9d17e8f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:32.177579 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9c6ad473-7849-4eb4-9b9d-3e40a9d17e8f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:32.178011 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9c6ad473-7849-4eb4-9b9d-3e40a9d17e8f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:32.332000 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9c6ad473-7849-4eb4-9b9d-3e40a9d17e8f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.166625 Dec 20 09:32:32.332681 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 299/642] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:32 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:32.494442 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b7dfc151-5a5c-44c4-9621-091a61e59765 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:32.494978 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b7dfc151-5a5c-44c4-9621-091a61e59765 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:32.502076 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b7dfc151-5a5c-44c4-9621-091a61e59765 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:32.502497 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b7dfc151-5a5c-44c4-9621-091a61e59765 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:32.503273 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b7dfc151-5a5c-44c4-9621-091a61e59765 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:32.503738 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b7dfc151-5a5c-44c4-9621-091a61e59765 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:32.632238 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b7dfc151-5a5c-44c4-9621-091a61e59765 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:32.639453 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b7dfc151-5a5c-44c4-9621-091a61e59765 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1317 microversion: 2.1 time: 0.148682 Dec 20 09:32:32.640719 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 344/643] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:32 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:32.690881 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-cd57dbad-0fd9-4422-8088-fe575e0b31c1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:32.691604 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-cd57dbad-0fd9-4422-8088-fe575e0b31c1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:32.698432 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cd57dbad-0fd9-4422-8088-fe575e0b31c1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:32.698879 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cd57dbad-0fd9-4422-8088-fe575e0b31c1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:32.699667 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cd57dbad-0fd9-4422-8088-fe575e0b31c1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:32.700115 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cd57dbad-0fd9-4422-8088-fe575e0b31c1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:32.826709 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-cd57dbad-0fd9-4422-8088-fe575e0b31c1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:32.835495 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-cd57dbad-0fd9-4422-8088-fe575e0b31c1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1555 microversion: 2.1 time: 0.149104 Dec 20 09:32:32.836095 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 300/644] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:32 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:33.072045 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-6071b09a-7fb7-4930-b309-1248c191c54b tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:33.072609 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-6071b09a-7fb7-4930-b309-1248c191c54b tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:33.078413 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6071b09a-7fb7-4930-b309-1248c191c54b tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:33.078852 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6071b09a-7fb7-4930-b309-1248c191c54b tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:33.079611 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6071b09a-7fb7-4930-b309-1248c191c54b tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:33.080065 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6071b09a-7fb7-4930-b309-1248c191c54b tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:33.204632 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-6071b09a-7fb7-4930-b309-1248c191c54b tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a7b3f4b8e54097a66d816d7f2ff8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c7a53cc0b4395b6360b5b19a1b9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:33.211649 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-6071b09a-7fb7-4930-b309-1248c191c54b tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 200 len: 1315 microversion: 2.1 time: 0.143291 Dec 20 09:32:33.212261 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 345/645] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:33 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:33.344446 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4c2afccc-491f-4a24-bcde-334a6a5b8c37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:33.345295 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4c2afccc-491f-4a24-bcde-334a6a5b8c37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:33.351466 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4c2afccc-491f-4a24-bcde-334a6a5b8c37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:33.352015 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4c2afccc-491f-4a24-bcde-334a6a5b8c37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:33.352784 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4c2afccc-491f-4a24-bcde-334a6a5b8c37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:33.353221 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4c2afccc-491f-4a24-bcde-334a6a5b8c37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:33.437165 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4c2afccc-491f-4a24-bcde-334a6a5b8c37 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.096802 Dec 20 09:32:33.437808 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 301/646] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:33 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:33.656886 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-50a55a3a-dbfe-4f3f-a6d6-d0e81c32ea40 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:33.657487 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-50a55a3a-dbfe-4f3f-a6d6-d0e81c32ea40 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:33.663744 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-50a55a3a-dbfe-4f3f-a6d6-d0e81c32ea40 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:33.664191 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-50a55a3a-dbfe-4f3f-a6d6-d0e81c32ea40 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:33.664962 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-50a55a3a-dbfe-4f3f-a6d6-d0e81c32ea40 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:33.665389 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-50a55a3a-dbfe-4f3f-a6d6-d0e81c32ea40 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:33.798894 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-50a55a3a-dbfe-4f3f-a6d6-d0e81c32ea40 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:33.806184 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-50a55a3a-dbfe-4f3f-a6d6-d0e81c32ea40 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1317 microversion: 2.1 time: 0.153535 Dec 20 09:32:33.806752 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 346/647] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:33 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:33.852682 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4a042acc-7a0e-4f01-9297-266d0418dbaa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:33.853458 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4a042acc-7a0e-4f01-9297-266d0418dbaa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:33.860630 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4a042acc-7a0e-4f01-9297-266d0418dbaa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:33.861083 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4a042acc-7a0e-4f01-9297-266d0418dbaa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:33.861863 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4a042acc-7a0e-4f01-9297-266d0418dbaa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:33.862303 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4a042acc-7a0e-4f01-9297-266d0418dbaa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:34.004928 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-4a042acc-7a0e-4f01-9297-266d0418dbaa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:34.013743 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4a042acc-7a0e-4f01-9297-266d0418dbaa tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1555 microversion: 2.1 time: 0.165032 Dec 20 09:32:34.014530 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 302/648] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:33 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:34.227456 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-abd00d4e-2615-4e84-824f-cf3afc1aef11 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:34.228142 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-abd00d4e-2615-4e84-824f-cf3afc1aef11 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:34.234058 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-abd00d4e-2615-4e84-824f-cf3afc1aef11 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:34.234505 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-abd00d4e-2615-4e84-824f-cf3afc1aef11 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:34.235335 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-abd00d4e-2615-4e84-824f-cf3afc1aef11 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:34.235798 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-abd00d4e-2615-4e84-824f-cf3afc1aef11 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:34.375391 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-abd00d4e-2615-4e84-824f-cf3afc1aef11 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a7b3f4b8e54097a66d816d7f2ff8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c7a53cc0b4395b6360b5b19a1b9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:34.382609 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-abd00d4e-2615-4e84-824f-cf3afc1aef11 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 200 len: 1315 microversion: 2.1 time: 0.158930 Dec 20 09:32:34.383177 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 347/649] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:34 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:34.448178 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-78b1f7d8-883e-4850-b2ec-be6b5e5dbd9e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:34.449144 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-78b1f7d8-883e-4850-b2ec-be6b5e5dbd9e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:34.456006 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-78b1f7d8-883e-4850-b2ec-be6b5e5dbd9e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:34.456461 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-78b1f7d8-883e-4850-b2ec-be6b5e5dbd9e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:34.457260 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-78b1f7d8-883e-4850-b2ec-be6b5e5dbd9e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:34.457676 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-78b1f7d8-883e-4850-b2ec-be6b5e5dbd9e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:34.589221 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-78b1f7d8-883e-4850-b2ec-be6b5e5dbd9e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.144693 Dec 20 09:32:34.590565 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 303/650] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:34 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:34.822171 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-2705991a-0255-493a-a20e-5fd48e0bacd8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:34.822773 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-2705991a-0255-493a-a20e-5fd48e0bacd8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:34.829671 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2705991a-0255-493a-a20e-5fd48e0bacd8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:34.830116 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2705991a-0255-493a-a20e-5fd48e0bacd8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:34.830892 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2705991a-0255-493a-a20e-5fd48e0bacd8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:34.831323 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2705991a-0255-493a-a20e-5fd48e0bacd8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:34.960756 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-2705991a-0255-493a-a20e-5fd48e0bacd8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:34.969400 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-2705991a-0255-493a-a20e-5fd48e0bacd8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1317 microversion: 2.1 time: 0.150709 Dec 20 09:32:34.970521 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 348/651] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:34 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:35.030558 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-93d8c511-0782-4622-b922-593243d67dc5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:35.031277 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-93d8c511-0782-4622-b922-593243d67dc5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:35.038081 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-93d8c511-0782-4622-b922-593243d67dc5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:35.038527 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-93d8c511-0782-4622-b922-593243d67dc5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:35.039304 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-93d8c511-0782-4622-b922-593243d67dc5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:35.039766 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-93d8c511-0782-4622-b922-593243d67dc5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:35.172383 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-93d8c511-0782-4622-b922-593243d67dc5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:35.180265 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-93d8c511-0782-4622-b922-593243d67dc5 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1561 microversion: 2.1 time: 0.153682 Dec 20 09:32:35.180844 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 304/652] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:35 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:35.245623 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ba207069-fb98-4361-8735-a3991f5f77da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:35.246121 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ba207069-fb98-4361-8735-a3991f5f77da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:35.252704 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ba207069-fb98-4361-8735-a3991f5f77da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:35.256129 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ba207069-fb98-4361-8735-a3991f5f77da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:35.256129 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ba207069-fb98-4361-8735-a3991f5f77da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:35.256129 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ba207069-fb98-4361-8735-a3991f5f77da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:35.330690 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.objects.instance [None req-ba207069-fb98-4361-8735-a3991f5f77da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lazy-loading 'services' on Instance uuid 1af8e934-5860-485f-abf5-42a2814d66e7 {{(pid=116674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:32:35.399756 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-45b6fd04-4924-4c39-a8c0-aae5e59804cf tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:35.400361 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-45b6fd04-4924-4c39-a8c0-aae5e59804cf tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:35.406658 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-45b6fd04-4924-4c39-a8c0-aae5e59804cf tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:35.407097 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-45b6fd04-4924-4c39-a8c0-aae5e59804cf tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:35.407893 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-45b6fd04-4924-4c39-a8c0-aae5e59804cf tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:35.408323 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-45b6fd04-4924-4c39-a8c0-aae5e59804cf tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:35.543151 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-45b6fd04-4924-4c39-a8c0-aae5e59804cf tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a7b3f4b8e54097a66d816d7f2ff8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c7a53cc0b4395b6360b5b19a1b9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:35.551337 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-45b6fd04-4924-4c39-a8c0-aae5e59804cf tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 200 len: 1315 microversion: 2.1 time: 0.154988 Dec 20 09:32:35.551947 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 305/653] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:35 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:35.567698 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ba207069-fb98-4361-8735-a3991f5f77da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7/os-volume_attachments/6d41b8a8-fcf1-4e69-b3c7-bc50e0469f7c" status: 202 len: 0 microversion: 2.1 time: 0.325600 Dec 20 09:32:35.568509 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 349/654] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 20 09:32:35 2021] DELETE /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7/os-volume_attachments/6d41b8a8-fcf1-4e69-b3c7-bc50e0469f7c => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:35.578668 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8d2036d9-8aa0-4105-a798-63bbc0154788 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:35.579573 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8d2036d9-8aa0-4105-a798-63bbc0154788 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:35.585590 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8d2036d9-8aa0-4105-a798-63bbc0154788 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:35.586054 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8d2036d9-8aa0-4105-a798-63bbc0154788 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:35.586818 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8d2036d9-8aa0-4105-a798-63bbc0154788 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:35.587249 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8d2036d9-8aa0-4105-a798-63bbc0154788 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:35.602255 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-09f81f4b-9fbd-407a-b318-3a3225b7f6ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:35.603339 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-09f81f4b-9fbd-407a-b318-3a3225b7f6ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:35.610247 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-09f81f4b-9fbd-407a-b318-3a3225b7f6ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:35.610706 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-09f81f4b-9fbd-407a-b318-3a3225b7f6ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:35.611482 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-09f81f4b-9fbd-407a-b318-3a3225b7f6ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:35.612014 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-09f81f4b-9fbd-407a-b318-3a3225b7f6ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:35.617079 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8d2036d9-8aa0-4105-a798-63bbc0154788 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042170 Dec 20 09:32:35.618346 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 306/655] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:32:35 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:32:35.774658 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-09f81f4b-9fbd-407a-b318-3a3225b7f6ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.176401 Dec 20 09:32:35.775311 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 350/656] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:35 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:32:35.991500 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-3bce0adf-63bc-4d2a-bd65-e0785ad5b8a9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:35.992136 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-3bce0adf-63bc-4d2a-bd65-e0785ad5b8a9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:35.998399 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3bce0adf-63bc-4d2a-bd65-e0785ad5b8a9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:35.998857 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3bce0adf-63bc-4d2a-bd65-e0785ad5b8a9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:35.999977 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3bce0adf-63bc-4d2a-bd65-e0785ad5b8a9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:36.000415 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3bce0adf-63bc-4d2a-bd65-e0785ad5b8a9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:36.145298 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-3bce0adf-63bc-4d2a-bd65-e0785ad5b8a9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:36.160781 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-3bce0adf-63bc-4d2a-bd65-e0785ad5b8a9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1317 microversion: 2.1 time: 0.166789 Dec 20 09:32:36.161404 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 307/657] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:35 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:36.568418 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b219bb9a-e98b-4d8b-a79d-aacb54fc7705 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:36.569081 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b219bb9a-e98b-4d8b-a79d-aacb54fc7705 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:36.575884 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b219bb9a-e98b-4d8b-a79d-aacb54fc7705 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:36.576331 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b219bb9a-e98b-4d8b-a79d-aacb54fc7705 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:36.577400 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b219bb9a-e98b-4d8b-a79d-aacb54fc7705 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:36.577939 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b219bb9a-e98b-4d8b-a79d-aacb54fc7705 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:36.629118 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e724196e-041f-4ac0-a77b-fc4af42939fb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:36.630081 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e724196e-041f-4ac0-a77b-fc4af42939fb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:36.636349 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e724196e-041f-4ac0-a77b-fc4af42939fb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:36.636794 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e724196e-041f-4ac0-a77b-fc4af42939fb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:36.637570 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e724196e-041f-4ac0-a77b-fc4af42939fb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:36.637998 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e724196e-041f-4ac0-a77b-fc4af42939fb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:36.668452 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e724196e-041f-4ac0-a77b-fc4af42939fb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043674 Dec 20 09:32:36.669033 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 308/658] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:32:36 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:32:36.765343 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b219bb9a-e98b-4d8b-a79d-aacb54fc7705 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a7b3f4b8e54097a66d816d7f2ff8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c7a53cc0b4395b6360b5b19a1b9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:36.778206 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b219bb9a-e98b-4d8b-a79d-aacb54fc7705 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 200 len: 1315 microversion: 2.1 time: 0.213692 Dec 20 09:32:36.778796 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 351/659] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:36 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:36.786864 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ce50dea9-941d-4fbd-891a-f23852eda1e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:36.787813 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ce50dea9-941d-4fbd-891a-f23852eda1e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:36.793698 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ce50dea9-941d-4fbd-891a-f23852eda1e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:36.794137 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ce50dea9-941d-4fbd-891a-f23852eda1e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:36.794893 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ce50dea9-941d-4fbd-891a-f23852eda1e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:36.795321 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ce50dea9-941d-4fbd-891a-f23852eda1e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:37.031812 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ce50dea9-941d-4fbd-891a-f23852eda1e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.248337 Dec 20 09:32:37.032463 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 309/660] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:36 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:37.177430 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8966fff2-5647-44f3-b123-b53cd1a7a1b0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:37.178221 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-8966fff2-5647-44f3-b123-b53cd1a7a1b0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:37.185713 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8966fff2-5647-44f3-b123-b53cd1a7a1b0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:37.189805 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8966fff2-5647-44f3-b123-b53cd1a7a1b0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:37.190969 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8966fff2-5647-44f3-b123-b53cd1a7a1b0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:37.192037 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8966fff2-5647-44f3-b123-b53cd1a7a1b0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:37.337611 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-8966fff2-5647-44f3-b123-b53cd1a7a1b0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:37.346121 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8966fff2-5647-44f3-b123-b53cd1a7a1b0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1317 microversion: 2.1 time: 0.172452 Dec 20 09:32:37.346695 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 352/661] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:37 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:37.679415 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-cfe6ad5b-f051-444f-acbc-ae8949d39c06 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:37.680425 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-cfe6ad5b-f051-444f-acbc-ae8949d39c06 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:37.687876 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cfe6ad5b-f051-444f-acbc-ae8949d39c06 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:37.688316 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cfe6ad5b-f051-444f-acbc-ae8949d39c06 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:37.689079 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cfe6ad5b-f051-444f-acbc-ae8949d39c06 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:37.689502 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cfe6ad5b-f051-444f-acbc-ae8949d39c06 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:37.717661 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-cfe6ad5b-f051-444f-acbc-ae8949d39c06 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042462 Dec 20 09:32:37.718200 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 310/662] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:32:37 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 09:32:37.795618 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-95e25161-d68b-41bf-8c66-f919b6ed60bc tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:37.796829 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-95e25161-d68b-41bf-8c66-f919b6ed60bc tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:37.806510 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-95e25161-d68b-41bf-8c66-f919b6ed60bc tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:37.806958 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-95e25161-d68b-41bf-8c66-f919b6ed60bc tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:37.807769 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-95e25161-d68b-41bf-8c66-f919b6ed60bc tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:37.808207 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-95e25161-d68b-41bf-8c66-f919b6ed60bc tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:37.938842 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-95e25161-d68b-41bf-8c66-f919b6ed60bc tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a7b3f4b8e54097a66d816d7f2ff8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c7a53cc0b4395b6360b5b19a1b9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:37.946274 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-95e25161-d68b-41bf-8c66-f919b6ed60bc tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 200 len: 1315 microversion: 2.1 time: 0.154380 Dec 20 09:32:37.947031 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 353/663] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:37 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:38.044502 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0cb18748-b85c-4aa5-af19-8de4d12759c4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:38.045764 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0cb18748-b85c-4aa5-af19-8de4d12759c4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:38.053548 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0cb18748-b85c-4aa5-af19-8de4d12759c4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:38.054003 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0cb18748-b85c-4aa5-af19-8de4d12759c4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:38.055034 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0cb18748-b85c-4aa5-af19-8de4d12759c4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:38.055489 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0cb18748-b85c-4aa5-af19-8de4d12759c4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:38.143784 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0cb18748-b85c-4aa5-af19-8de4d12759c4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.103436 Dec 20 09:32:38.144907 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 311/664] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:38 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:38.192072 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-8ef30e54-7a25-43f5-bd2d-ffd49423a39d req-c67bc782-0e88-415f-b8a3-13c55bb17528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "399b91a8-a248-4272-806a-cbfb84e66313", "name": "network-vif-plugged", "status": "completed", "tag": "f9f613bc-e935-42ad-9672-010d478a8336"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:38.193696 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:32:38.193696 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:32:38.200571 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-8ef30e54-7a25-43f5-bd2d-ffd49423a39d req-c67bc782-0e88-415f-b8a3-13c55bb17528 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:38.201019 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-8ef30e54-7a25-43f5-bd2d-ffd49423a39d req-c67bc782-0e88-415f-b8a3-13c55bb17528 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:38.211708 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-8ef30e54-7a25-43f5-bd2d-ffd49423a39d req-c67bc782-0e88-415f-b8a3-13c55bb17528 service nova] Creating event network-vif-plugged:f9f613bc-e935-42ad-9672-010d478a8336 for instance 399b91a8-a248-4272-806a-cbfb84e66313 on hv-cinder-81908 Dec 20 09:32:38.216434 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-8ef30e54-7a25-43f5-bd2d-ffd49423a39d req-c67bc782-0e88-415f-b8a3-13c55bb17528 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028484 Dec 20 09:32:38.217029 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 354/665] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:32:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:32:38.362612 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d80978b3-0887-4d8d-9b1b-24cd289093fa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:38.363330 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d80978b3-0887-4d8d-9b1b-24cd289093fa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:38.370259 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d80978b3-0887-4d8d-9b1b-24cd289093fa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:38.370695 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d80978b3-0887-4d8d-9b1b-24cd289093fa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:38.371459 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d80978b3-0887-4d8d-9b1b-24cd289093fa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:38.371914 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d80978b3-0887-4d8d-9b1b-24cd289093fa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:38.510044 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d80978b3-0887-4d8d-9b1b-24cd289093fa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:38.518213 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d80978b3-0887-4d8d-9b1b-24cd289093fa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1317 microversion: 2.1 time: 0.159572 Dec 20 09:32:38.518788 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 312/666] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:38 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:38.964206 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-62db157b-191c-4561-a10a-0e8c200e0c68 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:38.964838 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-62db157b-191c-4561-a10a-0e8c200e0c68 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:38.971462 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-62db157b-191c-4561-a10a-0e8c200e0c68 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:38.971989 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-62db157b-191c-4561-a10a-0e8c200e0c68 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:38.972768 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-62db157b-191c-4561-a10a-0e8c200e0c68 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:38.973206 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-62db157b-191c-4561-a10a-0e8c200e0c68 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:39.103929 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-62db157b-191c-4561-a10a-0e8c200e0c68 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a7b3f4b8e54097a66d816d7f2ff8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c7a53cc0b4395b6360b5b19a1b9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:39.111639 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-62db157b-191c-4561-a10a-0e8c200e0c68 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 200 len: 1315 microversion: 2.1 time: 0.152022 Dec 20 09:32:39.112238 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 355/667] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:38 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:39.156102 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-53058d3c-15fe-4f8e-ad0f-f85d96d71bef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:39.157048 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-53058d3c-15fe-4f8e-ad0f-f85d96d71bef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:39.163416 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-53058d3c-15fe-4f8e-ad0f-f85d96d71bef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:39.163920 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-53058d3c-15fe-4f8e-ad0f-f85d96d71bef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:39.164687 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-53058d3c-15fe-4f8e-ad0f-f85d96d71bef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:39.165117 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-53058d3c-15fe-4f8e-ad0f-f85d96d71bef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:39.244417 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-53058d3c-15fe-4f8e-ad0f-f85d96d71bef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.092381 Dec 20 09:32:39.244973 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 313/668] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:39 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:39.534157 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-91b6aff0-a3a0-45e0-a38e-77a3e354b255 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:39.534711 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-91b6aff0-a3a0-45e0-a38e-77a3e354b255 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:39.540447 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-91b6aff0-a3a0-45e0-a38e-77a3e354b255 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:39.540887 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-91b6aff0-a3a0-45e0-a38e-77a3e354b255 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:39.541656 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-91b6aff0-a3a0-45e0-a38e-77a3e354b255 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:39.542084 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-91b6aff0-a3a0-45e0-a38e-77a3e354b255 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:39.677486 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-91b6aff0-a3a0-45e0-a38e-77a3e354b255 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:39.684780 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-91b6aff0-a3a0-45e0-a38e-77a3e354b255 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1317 microversion: 2.1 time: 0.154391 Dec 20 09:32:39.685348 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 356/669] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:39 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:40.128823 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-30482306-53de-472e-849a-221110131451 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:40.129522 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-30482306-53de-472e-849a-221110131451 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:40.136358 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-30482306-53de-472e-849a-221110131451 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:40.136801 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-30482306-53de-472e-849a-221110131451 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:40.137576 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-30482306-53de-472e-849a-221110131451 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:40.138014 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-30482306-53de-472e-849a-221110131451 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:40.250130 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-390e6f2c-3f75-48f8-906a-28840e3bd3ee req-060708a8-3f1f-4e2b-ba8b-cfe771daaf46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae746f86-e246-49b6-93f3-71da2dd1967b", "name": "network-vif-plugged", "status": "completed", "tag": "038f6aed-163b-4433-8b88-e61fcbb2194a"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:40.252268 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:32:40.252268 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:32:40.263209 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-390e6f2c-3f75-48f8-906a-28840e3bd3ee req-060708a8-3f1f-4e2b-ba8b-cfe771daaf46 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:40.263961 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-390e6f2c-3f75-48f8-906a-28840e3bd3ee req-060708a8-3f1f-4e2b-ba8b-cfe771daaf46 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:40.283076 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-30482306-53de-472e-849a-221110131451 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a7b3f4b8e54097a66d816d7f2ff8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c7a53cc0b4395b6360b5b19a1b9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:40.283981 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-390e6f2c-3f75-48f8-906a-28840e3bd3ee req-060708a8-3f1f-4e2b-ba8b-cfe771daaf46 service nova] Creating event network-vif-plugged:038f6aed-163b-4433-8b88-e61fcbb2194a for instance ae746f86-e246-49b6-93f3-71da2dd1967b on hv-cinder-81908 Dec 20 09:32:40.291015 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-30482306-53de-472e-849a-221110131451 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 200 len: 1315 microversion: 2.1 time: 0.166452 Dec 20 09:32:40.291253 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-390e6f2c-3f75-48f8-906a-28840e3bd3ee req-060708a8-3f1f-4e2b-ba8b-cfe771daaf46 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046246 Dec 20 09:32:40.292181 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 314/670] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:40 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:40.292335 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 357/671] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:32:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:32:40.301459 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-7be3915f-3ad3-4c12-a5d8-79c25e004c94 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:40.302496 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-7be3915f-3ad3-4c12-a5d8-79c25e004c94 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:40.309103 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7be3915f-3ad3-4c12-a5d8-79c25e004c94 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:40.309553 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7be3915f-3ad3-4c12-a5d8-79c25e004c94 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:40.310489 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7be3915f-3ad3-4c12-a5d8-79c25e004c94 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:40.310922 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7be3915f-3ad3-4c12-a5d8-79c25e004c94 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:40.393558 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-7be3915f-3ad3-4c12-a5d8-79c25e004c94 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.097225 Dec 20 09:32:40.397864 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 315/672] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:40 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:40.702688 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f16745d5-dffb-4f91-a893-6795780e4a6e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:40.703455 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f16745d5-dffb-4f91-a893-6795780e4a6e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:40.709758 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f16745d5-dffb-4f91-a893-6795780e4a6e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:40.710212 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f16745d5-dffb-4f91-a893-6795780e4a6e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:40.711112 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f16745d5-dffb-4f91-a893-6795780e4a6e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:40.712593 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f16745d5-dffb-4f91-a893-6795780e4a6e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:40.852253 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f16745d5-dffb-4f91-a893-6795780e4a6e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:40.859479 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f16745d5-dffb-4f91-a893-6795780e4a6e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1317 microversion: 2.1 time: 0.161630 Dec 20 09:32:40.860069 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 358/673] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:40 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:41.309561 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ce32d8d8-6e41-4215-abfa-5cb5534eef08 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:41.310459 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ce32d8d8-6e41-4215-abfa-5cb5534eef08 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:41.318007 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ce32d8d8-6e41-4215-abfa-5cb5534eef08 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:41.319919 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ce32d8d8-6e41-4215-abfa-5cb5534eef08 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:41.319919 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ce32d8d8-6e41-4215-abfa-5cb5534eef08 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:41.319919 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ce32d8d8-6e41-4215-abfa-5cb5534eef08 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:41.404854 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-72012396-0772-4983-98af-59fdf323d189 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:41.407362 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-72012396-0772-4983-98af-59fdf323d189 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:41.414387 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-72012396-0772-4983-98af-59fdf323d189 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:41.415113 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-72012396-0772-4983-98af-59fdf323d189 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:41.415954 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-72012396-0772-4983-98af-59fdf323d189 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:41.423128 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-72012396-0772-4983-98af-59fdf323d189 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:41.507915 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-72012396-0772-4983-98af-59fdf323d189 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.106447 Dec 20 09:32:41.510856 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 359/674] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:41 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:32:41.511040 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ce32d8d8-6e41-4215-abfa-5cb5534eef08 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a7b3f4b8e54097a66d816d7f2ff8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c7a53cc0b4395b6360b5b19a1b9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:41.514146 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7a9831ee-2bed-4192-a8ae-70d9bd3a7d85 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81964746-a4ed-4ab5-8ec0-4dfd0b50a73a", "device": "/dev/sdb"}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:41.519236 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7a9831ee-2bed-4192-a8ae-70d9bd3a7d85 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:41.519367 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ce32d8d8-6e41-4215-abfa-5cb5534eef08 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 200 len: 1315 microversion: 2.1 time: 0.212426 Dec 20 09:32:41.519367 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 316/675] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:41 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:41.522836 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7a9831ee-2bed-4192-a8ae-70d9bd3a7d85 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:41.523282 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7a9831ee-2bed-4192-a8ae-70d9bd3a7d85 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:41.524085 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7a9831ee-2bed-4192-a8ae-70d9bd3a7d85 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:41.524688 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7a9831ee-2bed-4192-a8ae-70d9bd3a7d85 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:41.528246 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e278426f-0183-4dd8-870b-348762b51255 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:41.529247 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e278426f-0183-4dd8-870b-348762b51255 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:41.537436 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e278426f-0183-4dd8-870b-348762b51255 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:41.537969 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e278426f-0183-4dd8-870b-348762b51255 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:41.538856 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e278426f-0183-4dd8-870b-348762b51255 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:41.539366 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e278426f-0183-4dd8-870b-348762b51255 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:41.571921 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e278426f-0183-4dd8-870b-348762b51255 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Going to try to terminate instance {{(pid=116675) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 09:32:41.907534 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e278426f-0183-4dd8-870b-348762b51255 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "DELETE /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 204 len: 0 microversion: 2.1 time: 0.387802 Dec 20 09:32:41.908432 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 317/676] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 20 09:32:41 2021] DELETE /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 09:32:41.914348 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e8a565c7-6502-4b5b-ac69-edc49e340dd6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:41.915246 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e8a565c7-6502-4b5b-ac69-edc49e340dd6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:41.929302 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e8a565c7-6502-4b5b-ac69-edc49e340dd6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:41.929302 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e8a565c7-6502-4b5b-ac69-edc49e340dd6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:41.929302 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e8a565c7-6502-4b5b-ac69-edc49e340dd6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:41.929302 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e8a565c7-6502-4b5b-ac69-edc49e340dd6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:42.062051 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e8a565c7-6502-4b5b-ac69-edc49e340dd6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:42.069369 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e8a565c7-6502-4b5b-ac69-edc49e340dd6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1507 microversion: 2.1 time: 0.159499 Dec 20 09:32:42.069948 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 318/677] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:41 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:42.074122 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-eccbc127-7f6d-4b4f-b982-7131a5ff3ec2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:42.074776 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-eccbc127-7f6d-4b4f-b982-7131a5ff3ec2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:42.081742 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eccbc127-7f6d-4b4f-b982-7131a5ff3ec2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:42.082197 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eccbc127-7f6d-4b4f-b982-7131a5ff3ec2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:42.085278 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eccbc127-7f6d-4b4f-b982-7131a5ff3ec2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:42.085278 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eccbc127-7f6d-4b4f-b982-7131a5ff3ec2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:42.229694 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-eccbc127-7f6d-4b4f-b982-7131a5ff3ec2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:42.237159 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-eccbc127-7f6d-4b4f-b982-7131a5ff3ec2 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1508 microversion: 2.1 time: 0.166282 Dec 20 09:32:42.237723 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 319/678] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:42 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:42.326263 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7a9831ee-2bed-4192-a8ae-70d9bd3a7d85 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "POST /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.816280 Dec 20 09:32:42.327485 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 360/679] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 20 09:32:41 2021] POST /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf/os-volume_attachments => generated 194 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:32:42.518912 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-44476275-d27c-4f08-806a-de3e65343401 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:42.520009 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-44476275-d27c-4f08-806a-de3e65343401 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:42.526368 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-44476275-d27c-4f08-806a-de3e65343401 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:42.526813 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-44476275-d27c-4f08-806a-de3e65343401 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:42.527586 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-44476275-d27c-4f08-806a-de3e65343401 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:42.528050 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-44476275-d27c-4f08-806a-de3e65343401 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:42.536547 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-415b3a9b-906e-41b8-b33f-4dcfc797754b tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:42.537856 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-415b3a9b-906e-41b8-b33f-4dcfc797754b tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:42.544796 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-415b3a9b-906e-41b8-b33f-4dcfc797754b tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:42.547546 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-415b3a9b-906e-41b8-b33f-4dcfc797754b tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:42.547546 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-415b3a9b-906e-41b8-b33f-4dcfc797754b tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:42.547546 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-415b3a9b-906e-41b8-b33f-4dcfc797754b tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:42.627900 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-44476275-d27c-4f08-806a-de3e65343401 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.112374 Dec 20 09:32:42.635172 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 320/680] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:42 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:42.681287 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-415b3a9b-906e-41b8-b33f-4dcfc797754b tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a7b3f4b8e54097a66d816d7f2ff8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c7a53cc0b4395b6360b5b19a1b9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:42.689349 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-415b3a9b-906e-41b8-b33f-4dcfc797754b tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 200 len: 1315 microversion: 2.1 time: 0.156838 Dec 20 09:32:42.689935 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 361/681] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:42 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:43.254481 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c749908f-2d3c-4057-b425-f9419ec46c26 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:43.255213 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c749908f-2d3c-4057-b425-f9419ec46c26 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:43.262074 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c749908f-2d3c-4057-b425-f9419ec46c26 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:43.262523 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c749908f-2d3c-4057-b425-f9419ec46c26 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:43.263297 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c749908f-2d3c-4057-b425-f9419ec46c26 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:43.263759 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c749908f-2d3c-4057-b425-f9419ec46c26 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:43.396034 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-c749908f-2d3c-4057-b425-f9419ec46c26 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:43.403317 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c749908f-2d3c-4057-b425-f9419ec46c26 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1508 microversion: 2.1 time: 0.152858 Dec 20 09:32:43.403911 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 321/682] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:43 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:43.643554 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-279af0aa-7fa3-4aa1-8a4b-4a66cdaffc1c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:43.644553 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-279af0aa-7fa3-4aa1-8a4b-4a66cdaffc1c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:43.650722 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-279af0aa-7fa3-4aa1-8a4b-4a66cdaffc1c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:43.654755 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-279af0aa-7fa3-4aa1-8a4b-4a66cdaffc1c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:43.654755 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-279af0aa-7fa3-4aa1-8a4b-4a66cdaffc1c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:43.654755 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-279af0aa-7fa3-4aa1-8a4b-4a66cdaffc1c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:43.705818 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-be74e774-806d-4a52-b3be-0f2a123849a9 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:43.706432 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-be74e774-806d-4a52-b3be-0f2a123849a9 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:43.712632 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-be74e774-806d-4a52-b3be-0f2a123849a9 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:43.713236 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-be74e774-806d-4a52-b3be-0f2a123849a9 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:43.713846 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-be74e774-806d-4a52-b3be-0f2a123849a9 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:43.714295 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-be74e774-806d-4a52-b3be-0f2a123849a9 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:43.738038 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-279af0aa-7fa3-4aa1-8a4b-4a66cdaffc1c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28615 microversion: 2.20 time: 0.098507 Dec 20 09:32:43.742377 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 362/683] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:43 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28615 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:43.841798 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-be74e774-806d-4a52-b3be-0f2a123849a9 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a7b3f4b8e54097a66d816d7f2ff8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c7a53cc0b4395b6360b5b19a1b9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:43.849002 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-be74e774-806d-4a52-b3be-0f2a123849a9 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 200 len: 1465 microversion: 2.1 time: 0.147373 Dec 20 09:32:43.849556 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 322/684] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:43 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 1465 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:43.896051 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0c44e7b3-3777-42e5-91b8-23a5d1b532d7 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:43.896567 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0c44e7b3-3777-42e5-91b8-23a5d1b532d7 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:43.903345 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0c44e7b3-3777-42e5-91b8-23a5d1b532d7 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:43.903809 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0c44e7b3-3777-42e5-91b8-23a5d1b532d7 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:43.904577 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0c44e7b3-3777-42e5-91b8-23a5d1b532d7 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:43.905584 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0c44e7b3-3777-42e5-91b8-23a5d1b532d7 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:43.931720 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0c44e7b3-3777-42e5-91b8-23a5d1b532d7 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Going to try to terminate instance {{(pid=116674) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 09:32:44.231142 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0c44e7b3-3777-42e5-91b8-23a5d1b532d7 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 204 len: 0 microversion: 2.1 time: 0.339085 Dec 20 09:32:44.231753 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 363/685] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 20 09:32:43 2021] DELETE /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 09:32:44.240718 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-90251753-712f-4c5d-9795-ba2c5511c08a tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:44.242359 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-90251753-712f-4c5d-9795-ba2c5511c08a tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:44.247528 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-90251753-712f-4c5d-9795-ba2c5511c08a tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:44.248020 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-90251753-712f-4c5d-9795-ba2c5511c08a tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:44.249683 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-90251753-712f-4c5d-9795-ba2c5511c08a tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:44.250119 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-90251753-712f-4c5d-9795-ba2c5511c08a tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:44.384786 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-90251753-712f-4c5d-9795-ba2c5511c08a tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a7b3f4b8e54097a66d816d7f2ff8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c7a53cc0b4395b6360b5b19a1b9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:44.392991 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-90251753-712f-4c5d-9795-ba2c5511c08a tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 200 len: 1471 microversion: 2.1 time: 0.155869 Dec 20 09:32:44.393607 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 323/686] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:44 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:44.420992 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7fd981e0-c6e4-4275-986a-6891f378cfe9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:44.421698 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7fd981e0-c6e4-4275-986a-6891f378cfe9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:44.429607 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7fd981e0-c6e4-4275-986a-6891f378cfe9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:44.429607 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7fd981e0-c6e4-4275-986a-6891f378cfe9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:44.430334 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7fd981e0-c6e4-4275-986a-6891f378cfe9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:44.430446 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7fd981e0-c6e4-4275-986a-6891f378cfe9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:44.562558 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7fd981e0-c6e4-4275-986a-6891f378cfe9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:44.569672 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7fd981e0-c6e4-4275-986a-6891f378cfe9 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1508 microversion: 2.1 time: 0.152801 Dec 20 09:32:44.570352 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 364/687] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:44 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:44.749559 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-81740cba-0a52-4ae9-acc5-229be1634912 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:44.750473 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-81740cba-0a52-4ae9-acc5-229be1634912 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:44.757006 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-81740cba-0a52-4ae9-acc5-229be1634912 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:44.758176 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-81740cba-0a52-4ae9-acc5-229be1634912 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:44.758294 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-81740cba-0a52-4ae9-acc5-229be1634912 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:44.758795 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-81740cba-0a52-4ae9-acc5-229be1634912 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:44.764808 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5420a99c-8b08-4098-be58-0941b9b54ca2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "334c5971-e69f-48f3-afd5-d70831bfba2f"}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:44.765973 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-5420a99c-8b08-4098-be58-0941b9b54ca2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:44.771802 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5420a99c-8b08-4098-be58-0941b9b54ca2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:44.772256 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5420a99c-8b08-4098-be58-0941b9b54ca2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:44.773038 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5420a99c-8b08-4098-be58-0941b9b54ca2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:44.773472 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5420a99c-8b08-4098-be58-0941b9b54ca2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:44.875282 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-81740cba-0a52-4ae9-acc5-229be1634912 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 28889 microversion: 2.20 time: 0.129766 Dec 20 09:32:44.875993 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 324/688] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:44 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 28889 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:45.410827 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-fc4696a6-47d9-4370-94e0-2eb12d0fdb12 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:45.411567 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-fc4696a6-47d9-4370-94e0-2eb12d0fdb12 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:45.418533 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fc4696a6-47d9-4370-94e0-2eb12d0fdb12 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:45.418981 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fc4696a6-47d9-4370-94e0-2eb12d0fdb12 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:45.419792 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fc4696a6-47d9-4370-94e0-2eb12d0fdb12 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:45.420249 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fc4696a6-47d9-4370-94e0-2eb12d0fdb12 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:45.445172 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-5420a99c-8b08-4098-be58-0941b9b54ca2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "POST /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.683960 Dec 20 09:32:45.454783 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 365/689] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 20 09:32:44 2021] POST /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313/os-volume_attachments => generated 194 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:32:45.562227 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-fc4696a6-47d9-4370-94e0-2eb12d0fdb12 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a7b3f4b8e54097a66d816d7f2ff8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c7a53cc0b4395b6360b5b19a1b9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:45.569716 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-fc4696a6-47d9-4370-94e0-2eb12d0fdb12 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 200 len: 1471 microversion: 2.1 time: 0.163109 Dec 20 09:32:45.570992 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 325/690] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:45 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:45.587209 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-35c49fdb-a39e-4ec8-b5bd-dd8d3b52967f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:45.587946 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-35c49fdb-a39e-4ec8-b5bd-dd8d3b52967f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:45.594524 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-35c49fdb-a39e-4ec8-b5bd-dd8d3b52967f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:45.594524 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-35c49fdb-a39e-4ec8-b5bd-dd8d3b52967f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:45.595225 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-35c49fdb-a39e-4ec8-b5bd-dd8d3b52967f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:45.595683 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-35c49fdb-a39e-4ec8-b5bd-dd8d3b52967f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:45.733599 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-35c49fdb-a39e-4ec8-b5bd-dd8d3b52967f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:45.741044 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-35c49fdb-a39e-4ec8-b5bd-dd8d3b52967f tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1508 microversion: 2.1 time: 0.158423 Dec 20 09:32:45.741614 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 366/691] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:45 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:45.886415 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c9460cb9-6c6a-4459-9e30-aacf24e0b124 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:45.887441 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c9460cb9-6c6a-4459-9e30-aacf24e0b124 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:45.893756 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9460cb9-6c6a-4459-9e30-aacf24e0b124 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:45.894260 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9460cb9-6c6a-4459-9e30-aacf24e0b124 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:45.895103 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9460cb9-6c6a-4459-9e30-aacf24e0b124 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:45.895535 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9460cb9-6c6a-4459-9e30-aacf24e0b124 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:45.988273 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c9460cb9-6c6a-4459-9e30-aacf24e0b124 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 30030 microversion: 2.20 time: 0.105283 Dec 20 09:32:45.989626 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 326/692] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:45 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 30030 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:32:46.099134 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-0a5ab8bc-6861-4c19-8ab9-0972185209f5 req-812eb9cb-4b91-4a5d-8439-3033185a5d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb93a254-d6ca-433b-8317-d0a21f49cdf9", "name": "network-vif-deleted", "tag": "87d44c65-d907-4b8c-b972-32c1d837d695"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:46.100982 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:32:46.100982 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:32:46.109086 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-0a5ab8bc-6861-4c19-8ab9-0972185209f5 req-812eb9cb-4b91-4a5d-8439-3033185a5d5f service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:46.112518 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-0a5ab8bc-6861-4c19-8ab9-0972185209f5 req-812eb9cb-4b91-4a5d-8439-3033185a5d5f service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:46.120841 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-0a5ab8bc-6861-4c19-8ab9-0972185209f5 req-812eb9cb-4b91-4a5d-8439-3033185a5d5f service nova] Creating event network-vif-deleted:87d44c65-d907-4b8c-b972-32c1d837d695 for instance eb93a254-d6ca-433b-8317-d0a21f49cdf9 on hv-cinder-81908 Dec 20 09:32:46.125897 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-0a5ab8bc-6861-4c19-8ab9-0972185209f5 req-812eb9cb-4b91-4a5d-8439-3033185a5d5f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031038 Dec 20 09:32:46.126492 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 367/693] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:32:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:32:46.594722 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4953a248-7d5a-493d-82ae-21e950a05997 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:46.594722 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4953a248-7d5a-493d-82ae-21e950a05997 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:46.596406 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4953a248-7d5a-493d-82ae-21e950a05997 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:46.596852 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4953a248-7d5a-493d-82ae-21e950a05997 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:46.597634 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4953a248-7d5a-493d-82ae-21e950a05997 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:46.598063 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4953a248-7d5a-493d-82ae-21e950a05997 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:46.733261 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-4953a248-7d5a-493d-82ae-21e950a05997 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a7b3f4b8e54097a66d816d7f2ff8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c7a53cc0b4395b6360b5b19a1b9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:46.743052 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4953a248-7d5a-493d-82ae-21e950a05997 tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 200 len: 1471 microversion: 2.1 time: 0.158356 Dec 20 09:32:46.744895 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 327/694] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:46 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:46.758764 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ea4e8905-1127-41f5-bb03-0c95cc6a1eac tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:46.759528 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ea4e8905-1127-41f5-bb03-0c95cc6a1eac tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:46.766283 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ea4e8905-1127-41f5-bb03-0c95cc6a1eac tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:46.766672 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ea4e8905-1127-41f5-bb03-0c95cc6a1eac tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:46.767455 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ea4e8905-1127-41f5-bb03-0c95cc6a1eac tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:46.768090 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ea4e8905-1127-41f5-bb03-0c95cc6a1eac tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:46.798281 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ea4e8905-1127-41f5-bb03-0c95cc6a1eac tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:46.798732 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ea4e8905-1127-41f5-bb03-0c95cc6a1eac tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:46.799178 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.objects.instance [None req-ea4e8905-1127-41f5-bb03-0c95cc6a1eac tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lazy-loading 'fault' on Instance uuid eb93a254-d6ca-433b-8317-d0a21f49cdf9 {{(pid=116674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:32:46.842050 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ea4e8905-1127-41f5-bb03-0c95cc6a1eac tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:46.850053 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ea4e8905-1127-41f5-bb03-0c95cc6a1eac tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 200 len: 1311 microversion: 2.1 time: 0.095383 Dec 20 09:32:46.850625 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 368/695] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:46 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:47.004441 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6d980c2a-e822-4adf-8d6b-6d5a66f403a6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:47.006245 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6d980c2a-e822-4adf-8d6b-6d5a66f403a6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:47.013318 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6d980c2a-e822-4adf-8d6b-6d5a66f403a6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:47.014055 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6d980c2a-e822-4adf-8d6b-6d5a66f403a6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:47.015409 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6d980c2a-e822-4adf-8d6b-6d5a66f403a6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:47.015881 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6d980c2a-e822-4adf-8d6b-6d5a66f403a6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:47.113745 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6d980c2a-e822-4adf-8d6b-6d5a66f403a6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 31440 microversion: 2.20 time: 0.117361 Dec 20 09:32:47.115185 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 328/696] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:46 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 31440 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:47.760160 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-6cd38fc2-9938-46a8-8379-2d6bc39db5ab tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:47.760789 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-6cd38fc2-9938-46a8-8379-2d6bc39db5ab tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:47.767801 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6cd38fc2-9938-46a8-8379-2d6bc39db5ab tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:47.768253 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6cd38fc2-9938-46a8-8379-2d6bc39db5ab tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:47.769025 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6cd38fc2-9938-46a8-8379-2d6bc39db5ab tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:47.769462 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6cd38fc2-9938-46a8-8379-2d6bc39db5ab tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:47.800356 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6cd38fc2-9938-46a8-8379-2d6bc39db5ab tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:47.800792 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6cd38fc2-9938-46a8-8379-2d6bc39db5ab tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:47.801226 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.objects.instance [None req-6cd38fc2-9938-46a8-8379-2d6bc39db5ab tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lazy-loading 'fault' on Instance uuid ae746f86-e246-49b6-93f3-71da2dd1967b {{(pid=116674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:32:47.839450 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-6cd38fc2-9938-46a8-8379-2d6bc39db5ab tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a7b3f4b8e54097a66d816d7f2ff8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c7a53cc0b4395b6360b5b19a1b9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:47.846588 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-6cd38fc2-9938-46a8-8379-2d6bc39db5ab tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 200 len: 1305 microversion: 2.1 time: 0.090066 Dec 20 09:32:47.853065 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 369/697] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:47 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 1305 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:47.867400 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-fa4f7f53-f717-487e-8f13-aa055e003562 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:47.868128 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-fa4f7f53-f717-487e-8f13-aa055e003562 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: eb93a254-d6ca-433b-8317-d0a21f49cdf9] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:47.875694 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fa4f7f53-f717-487e-8f13-aa055e003562 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:47.879138 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fa4f7f53-f717-487e-8f13-aa055e003562 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:47.879138 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fa4f7f53-f717-487e-8f13-aa055e003562 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:47.879138 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fa4f7f53-f717-487e-8f13-aa055e003562 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:47.890634 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-fa4f7f53-f717-487e-8f13-aa055e003562 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] HTTP exception thrown: Instance eb93a254-d6ca-433b-8317-d0a21f49cdf9 could not be found. Dec 20 09:32:47.891212 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-fa4f7f53-f717-487e-8f13-aa055e003562 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Returning 404 to user: Instance eb93a254-d6ca-433b-8317-d0a21f49cdf9 could not be found. {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:32:47.892047 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-fa4f7f53-f717-487e-8f13-aa055e003562 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9" status: 404 len: 111 microversion: 2.1 time: 0.028586 Dec 20 09:32:47.892569 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 329/698] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:47 2021] GET /compute/v2.1/servers/eb93a254-d6ca-433b-8317-d0a21f49cdf9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 20 09:32:47.900484 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-00b24c56-36e2-4856-863a-21a0c5e804cb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:47.901035 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-00b24c56-36e2-4856-863a-21a0c5e804cb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:47.906917 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-00b24c56-36e2-4856-863a-21a0c5e804cb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:47.910916 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-00b24c56-36e2-4856-863a-21a0c5e804cb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:47.910916 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-00b24c56-36e2-4856-863a-21a0c5e804cb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:47.910916 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-00b24c56-36e2-4856-863a-21a0c5e804cb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:47.933492 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-00b24c56-36e2-4856-863a-21a0c5e804cb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Going to try to terminate instance {{(pid=116674) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 09:32:48.126684 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-fd30752b-9687-4c47-aa93-c691ae7549f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:48.127546 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-fd30752b-9687-4c47-aa93-c691ae7549f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:48.133956 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fd30752b-9687-4c47-aa93-c691ae7549f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:48.134407 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fd30752b-9687-4c47-aa93-c691ae7549f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:48.135316 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fd30752b-9687-4c47-aa93-c691ae7549f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:48.135776 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fd30752b-9687-4c47-aa93-c691ae7549f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:48.168521 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-00b24c56-36e2-4856-863a-21a0c5e804cb tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 204 len: 0 microversion: 2.1 time: 0.271676 Dec 20 09:32:48.169218 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 370/699] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 20 09:32:47 2021] DELETE /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 09:32:48.175051 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-e5194c1d-2376-4a59-adb5-62208ba959ba req-35c45a13-5d1c-4678-b133-7ab0a518f435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae746f86-e246-49b6-93f3-71da2dd1967b", "name": "network-vif-deleted", "tag": "038f6aed-163b-4433-8b88-e61fcbb2194a"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:48.176607 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:32:48.176607 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:32:48.183352 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-e5194c1d-2376-4a59-adb5-62208ba959ba req-35c45a13-5d1c-4678-b133-7ab0a518f435 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:48.183821 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-e5194c1d-2376-4a59-adb5-62208ba959ba req-35c45a13-5d1c-4678-b133-7ab0a518f435 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:48.194832 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-e5194c1d-2376-4a59-adb5-62208ba959ba req-35c45a13-5d1c-4678-b133-7ab0a518f435 service nova] Creating event network-vif-deleted:038f6aed-163b-4433-8b88-e61fcbb2194a for instance ae746f86-e246-49b6-93f3-71da2dd1967b on hv-cinder-81908 Dec 20 09:32:48.199489 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-e5194c1d-2376-4a59-adb5-62208ba959ba req-35c45a13-5d1c-4678-b133-7ab0a518f435 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028876 Dec 20 09:32:48.200133 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 371/700] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:32:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:32:48.204985 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-292a9061-7b2c-4489-b952-c8ef9265188d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:48.205676 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-292a9061-7b2c-4489-b952-c8ef9265188d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:48.211584 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-292a9061-7b2c-4489-b952-c8ef9265188d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:48.212063 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-292a9061-7b2c-4489-b952-c8ef9265188d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:48.212840 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-292a9061-7b2c-4489-b952-c8ef9265188d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:48.213276 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-292a9061-7b2c-4489-b952-c8ef9265188d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:48.239774 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-fd30752b-9687-4c47-aa93-c691ae7549f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 33045 microversion: 2.20 time: 0.117598 Dec 20 09:32:48.243596 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 330/701] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:48 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 33045 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:32:48.345071 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-292a9061-7b2c-4489-b952-c8ef9265188d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:48.352509 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-292a9061-7b2c-4489-b952-c8ef9265188d tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.151197 Dec 20 09:32:48.353077 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 372/702] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:48 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:48.864011 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-698b8687-8a78-4a2a-987b-e6fc87c7762d tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:48.864701 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-698b8687-8a78-4a2a-987b-e6fc87c7762d tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] [instance: ae746f86-e246-49b6-93f3-71da2dd1967b] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:48.871377 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-698b8687-8a78-4a2a-987b-e6fc87c7762d tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:48.871850 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-698b8687-8a78-4a2a-987b-e6fc87c7762d tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:48.872616 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-698b8687-8a78-4a2a-987b-e6fc87c7762d tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:48.873038 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-698b8687-8a78-4a2a-987b-e6fc87c7762d tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:48.886820 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-698b8687-8a78-4a2a-987b-e6fc87c7762d tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] HTTP exception thrown: Instance ae746f86-e246-49b6-93f3-71da2dd1967b could not be found. Dec 20 09:32:48.887386 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-698b8687-8a78-4a2a-987b-e6fc87c7762d tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] Returning 404 to user: Instance ae746f86-e246-49b6-93f3-71da2dd1967b could not be found. {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:32:48.888210 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-698b8687-8a78-4a2a-987b-e6fc87c7762d tempest-VolumesNegativeTest-398948819 tempest-VolumesNegativeTest-398948819-project] 10.222.0.62 "GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b" status: 404 len: 111 microversion: 2.1 time: 0.028251 Dec 20 09:32:48.888718 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 331/703] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:48 2021] GET /compute/v2.1/servers/ae746f86-e246-49b6-93f3-71da2dd1967b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:32:49.252213 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5522d512-2692-4ad1-8294-0df237d413ce tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:49.253152 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-5522d512-2692-4ad1-8294-0df237d413ce tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:49.259292 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5522d512-2692-4ad1-8294-0df237d413ce tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:49.259769 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5522d512-2692-4ad1-8294-0df237d413ce tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:49.260580 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5522d512-2692-4ad1-8294-0df237d413ce tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:49.261025 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5522d512-2692-4ad1-8294-0df237d413ce tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:49.355067 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-5522d512-2692-4ad1-8294-0df237d413ce tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 33527 microversion: 2.20 time: 0.105453 Dec 20 09:32:49.355067 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 373/704] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:49 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 33527 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:49.369570 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-91417f92-4ed0-4f3f-b946-b5950842a2dc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:49.370170 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-91417f92-4ed0-4f3f-b946-b5950842a2dc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:49.378034 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-91417f92-4ed0-4f3f-b946-b5950842a2dc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:49.378566 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-91417f92-4ed0-4f3f-b946-b5950842a2dc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:49.379425 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-91417f92-4ed0-4f3f-b946-b5950842a2dc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:49.380068 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-91417f92-4ed0-4f3f-b946-b5950842a2dc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:49.525303 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-91417f92-4ed0-4f3f-b946-b5950842a2dc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:49.533386 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-91417f92-4ed0-4f3f-b946-b5950842a2dc tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.167560 Dec 20 09:32:49.533954 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 332/705] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:49 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:50.365177 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5dfeeae9-6398-4b59-855a-88750d2cc984 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:50.366210 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-5dfeeae9-6398-4b59-855a-88750d2cc984 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:50.373169 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5dfeeae9-6398-4b59-855a-88750d2cc984 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:50.375997 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5dfeeae9-6398-4b59-855a-88750d2cc984 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:50.375997 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5dfeeae9-6398-4b59-855a-88750d2cc984 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:50.375997 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5dfeeae9-6398-4b59-855a-88750d2cc984 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:50.477533 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-5dfeeae9-6398-4b59-855a-88750d2cc984 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 33940 microversion: 2.20 time: 0.115763 Dec 20 09:32:50.483631 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 374/706] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:50 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 33940 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:32:50.548650 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4b5163af-ffc1-4b04-997d-591b720cad41 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:50.549258 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4b5163af-ffc1-4b04-997d-591b720cad41 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:50.555466 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4b5163af-ffc1-4b04-997d-591b720cad41 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:50.555953 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4b5163af-ffc1-4b04-997d-591b720cad41 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:50.556763 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4b5163af-ffc1-4b04-997d-591b720cad41 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:50.557201 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4b5163af-ffc1-4b04-997d-591b720cad41 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:50.688284 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-4b5163af-ffc1-4b04-997d-591b720cad41 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:50.695401 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4b5163af-ffc1-4b04-997d-591b720cad41 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.150383 Dec 20 09:32:50.696007 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 333/707] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:50 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:51.491992 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-26d7577f-85a4-405f-8f68-70c64aea6bce tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:51.492981 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-26d7577f-85a4-405f-8f68-70c64aea6bce tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:51.499965 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-26d7577f-85a4-405f-8f68-70c64aea6bce tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:51.500407 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-26d7577f-85a4-405f-8f68-70c64aea6bce tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:51.501176 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-26d7577f-85a4-405f-8f68-70c64aea6bce tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:51.501604 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-26d7577f-85a4-405f-8f68-70c64aea6bce tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:51.712024 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ad8b39db-81b4-4879-8ce0-8372b6f00627 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:51.712666 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ad8b39db-81b4-4879-8ce0-8372b6f00627 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:51.718965 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ad8b39db-81b4-4879-8ce0-8372b6f00627 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:51.719413 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ad8b39db-81b4-4879-8ce0-8372b6f00627 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:51.720370 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ad8b39db-81b4-4879-8ce0-8372b6f00627 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:51.720804 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ad8b39db-81b4-4879-8ce0-8372b6f00627 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:51.861700 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ad8b39db-81b4-4879-8ce0-8372b6f00627 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:51.868382 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ad8b39db-81b4-4879-8ce0-8372b6f00627 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.160394 Dec 20 09:32:51.868937 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 334/708] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:51 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:52.887184 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4f2b2ff3-a36e-440a-8a28-2c321e298dc8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:52.887184 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4f2b2ff3-a36e-440a-8a28-2c321e298dc8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:52.893464 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4f2b2ff3-a36e-440a-8a28-2c321e298dc8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:52.894009 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4f2b2ff3-a36e-440a-8a28-2c321e298dc8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:52.894991 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4f2b2ff3-a36e-440a-8a28-2c321e298dc8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:52.895501 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4f2b2ff3-a36e-440a-8a28-2c321e298dc8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:53.026954 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-4f2b2ff3-a36e-440a-8a28-2c321e298dc8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:53.036887 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4f2b2ff3-a36e-440a-8a28-2c321e298dc8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.155103 Dec 20 09:32:53.037607 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 335/709] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:52 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:54.053700 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8ba9c801-e137-4004-b44d-8e6a78ab3a67 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:54.054296 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8ba9c801-e137-4004-b44d-8e6a78ab3a67 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:54.060431 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8ba9c801-e137-4004-b44d-8e6a78ab3a67 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:54.060880 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8ba9c801-e137-4004-b44d-8e6a78ab3a67 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:54.063706 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8ba9c801-e137-4004-b44d-8e6a78ab3a67 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:54.063706 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8ba9c801-e137-4004-b44d-8e6a78ab3a67 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:54.194388 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8ba9c801-e137-4004-b44d-8e6a78ab3a67 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:54.202039 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8ba9c801-e137-4004-b44d-8e6a78ab3a67 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.151865 Dec 20 09:32:54.202703 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 336/710] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:54 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:55.004547 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-26d7577f-85a4-405f-8f68-70c64aea6bce tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 37849 microversion: 2.20 time: 3.516454 Dec 20 09:32:55.008702 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 375/711] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:51 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 37849 bytes in 3519 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:32:55.218303 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-fb05559e-441c-40fd-962a-604603ff940c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:55.218919 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-fb05559e-441c-40fd-962a-604603ff940c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:55.225139 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fb05559e-441c-40fd-962a-604603ff940c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:55.225581 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fb05559e-441c-40fd-962a-604603ff940c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:55.226345 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fb05559e-441c-40fd-962a-604603ff940c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:55.226772 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fb05559e-441c-40fd-962a-604603ff940c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:55.354834 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-fb05559e-441c-40fd-962a-604603ff940c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:55.366511 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-fb05559e-441c-40fd-962a-604603ff940c tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.151759 Dec 20 09:32:55.367304 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 337/712] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:55 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:32:56.016726 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-98227111-6be2-4fca-860d-9a7de586e723 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:32:56.017721 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-98227111-6be2-4fca-860d-9a7de586e723 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:56.025134 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-98227111-6be2-4fca-860d-9a7de586e723 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:56.025576 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-98227111-6be2-4fca-860d-9a7de586e723 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:56.026350 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-98227111-6be2-4fca-860d-9a7de586e723 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:56.026782 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-98227111-6be2-4fca-860d-9a7de586e723 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:56.383779 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-06fa24ab-c8f4-4dbd-b6ce-d702880895a3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:56.384390 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-06fa24ab-c8f4-4dbd-b6ce-d702880895a3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:56.391393 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-06fa24ab-c8f4-4dbd-b6ce-d702880895a3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:56.391879 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-06fa24ab-c8f4-4dbd-b6ce-d702880895a3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:56.392703 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-06fa24ab-c8f4-4dbd-b6ce-d702880895a3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:56.393147 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-06fa24ab-c8f4-4dbd-b6ce-d702880895a3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:56.524547 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-06fa24ab-c8f4-4dbd-b6ce-d702880895a3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:56.532128 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-06fa24ab-c8f4-4dbd-b6ce-d702880895a3 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.152084 Dec 20 09:32:56.532698 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 338/713] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:56 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:57.548290 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-25ab3bc9-c87d-49f2-b8d9-e996024bb7a8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:57.548881 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-25ab3bc9-c87d-49f2-b8d9-e996024bb7a8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:57.555052 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-25ab3bc9-c87d-49f2-b8d9-e996024bb7a8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:57.555505 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-25ab3bc9-c87d-49f2-b8d9-e996024bb7a8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:57.556312 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-25ab3bc9-c87d-49f2-b8d9-e996024bb7a8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:57.556747 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-25ab3bc9-c87d-49f2-b8d9-e996024bb7a8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:57.682166 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-25ab3bc9-c87d-49f2-b8d9-e996024bb7a8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:57.689963 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-25ab3bc9-c87d-49f2-b8d9-e996024bb7a8 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.145416 Dec 20 09:32:57.690533 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 339/714] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:57 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:58.706488 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f245584e-05d6-42e0-899e-411da4e9a6a1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:58.707145 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f245584e-05d6-42e0-899e-411da4e9a6a1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:58.713485 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f245584e-05d6-42e0-899e-411da4e9a6a1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:58.713934 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f245584e-05d6-42e0-899e-411da4e9a6a1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:58.714710 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f245584e-05d6-42e0-899e-411da4e9a6a1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:58.715154 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f245584e-05d6-42e0-899e-411da4e9a6a1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:58.846717 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f245584e-05d6-42e0-899e-411da4e9a6a1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:32:58.853818 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f245584e-05d6-42e0-899e-411da4e9a6a1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.150964 Dec 20 09:32:58.854379 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 340/715] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:58 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:32:59.869977 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9dc915cf-acb5-447b-83c2-2a69d331afab tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:32:59.870585 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9dc915cf-acb5-447b-83c2-2a69d331afab tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:32:59.877195 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9dc915cf-acb5-447b-83c2-2a69d331afab tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:59.877632 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9dc915cf-acb5-447b-83c2-2a69d331afab tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:32:59.878391 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9dc915cf-acb5-447b-83c2-2a69d331afab tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:32:59.878818 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9dc915cf-acb5-447b-83c2-2a69d331afab tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:00.004938 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-9dc915cf-acb5-447b-83c2-2a69d331afab tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:00.012134 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9dc915cf-acb5-447b-83c2-2a69d331afab tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.145725 Dec 20 09:33:00.012687 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 341/716] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:32:59 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:00.175349 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-98227111-6be2-4fca-860d-9a7de586e723 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 38159 microversion: 2.20 time: 4.162431 Dec 20 09:33:00.179508 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 376/717] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:32:56 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 38159 bytes in 4164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:33:01.028236 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d4f2abe4-b00b-40d7-96f4-80c46403d3a1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:01.028838 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d4f2abe4-b00b-40d7-96f4-80c46403d3a1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:01.035501 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d4f2abe4-b00b-40d7-96f4-80c46403d3a1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:01.035970 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d4f2abe4-b00b-40d7-96f4-80c46403d3a1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:01.036742 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d4f2abe4-b00b-40d7-96f4-80c46403d3a1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:01.037176 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d4f2abe4-b00b-40d7-96f4-80c46403d3a1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:01.164589 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d4f2abe4-b00b-40d7-96f4-80c46403d3a1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:01.172423 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d4f2abe4-b00b-40d7-96f4-80c46403d3a1 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.147861 Dec 20 09:33:01.173025 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 342/718] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:01 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:01.186916 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-2a8f4ffe-f289-434d-bffd-7c22d6829b6d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:33:01.187975 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-2a8f4ffe-f289-434d-bffd-7c22d6829b6d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:01.195605 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2a8f4ffe-f289-434d-bffd-7c22d6829b6d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:01.196078 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2a8f4ffe-f289-434d-bffd-7c22d6829b6d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:01.196850 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2a8f4ffe-f289-434d-bffd-7c22d6829b6d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:01.197283 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2a8f4ffe-f289-434d-bffd-7c22d6829b6d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:01.298956 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-2a8f4ffe-f289-434d-bffd-7c22d6829b6d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 38159 microversion: 2.20 time: 0.115853 Dec 20 09:33:01.299537 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 377/719] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:33:01 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 38159 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:33:02.189548 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b4ceba04-27b7-4178-ae64-94d432f49b83 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:02.190147 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b4ceba04-27b7-4178-ae64-94d432f49b83 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:02.196329 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b4ceba04-27b7-4178-ae64-94d432f49b83 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:02.196782 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b4ceba04-27b7-4178-ae64-94d432f49b83 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:02.197560 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b4ceba04-27b7-4178-ae64-94d432f49b83 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:02.198001 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b4ceba04-27b7-4178-ae64-94d432f49b83 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:02.311639 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3bd694d1-4bd5-4a43-8674-e953b4669f1b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:33:02.312846 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-3bd694d1-4bd5-4a43-8674-e953b4669f1b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:02.320121 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3bd694d1-4bd5-4a43-8674-e953b4669f1b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:02.320602 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3bd694d1-4bd5-4a43-8674-e953b4669f1b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:02.321554 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3bd694d1-4bd5-4a43-8674-e953b4669f1b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:02.322017 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3bd694d1-4bd5-4a43-8674-e953b4669f1b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:02.338223 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b4ceba04-27b7-4178-ae64-94d432f49b83 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:02.345416 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b4ceba04-27b7-4178-ae64-94d432f49b83 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.160228 Dec 20 09:33:02.345983 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 343/720] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:02 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:02.387612 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3bd694d1-4bd5-4a43-8674-e953b4669f1b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 38159 microversion: 2.20 time: 0.080545 Dec 20 09:33:02.388291 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 378/721] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:33:02 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 38159 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:33:03.362505 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-5ac35310-be13-4f10-ad69-f19831837983 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:03.363114 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-5ac35310-be13-4f10-ad69-f19831837983 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:03.369305 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5ac35310-be13-4f10-ad69-f19831837983 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:03.369760 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5ac35310-be13-4f10-ad69-f19831837983 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:03.370538 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5ac35310-be13-4f10-ad69-f19831837983 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:03.371342 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5ac35310-be13-4f10-ad69-f19831837983 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:03.406780 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9c3516f2-7a40-4949-a444-3c4f7a70fe89 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:33:03.407851 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9c3516f2-7a40-4949-a444-3c4f7a70fe89 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:03.432487 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9c3516f2-7a40-4949-a444-3c4f7a70fe89 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:03.433166 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9c3516f2-7a40-4949-a444-3c4f7a70fe89 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:03.434877 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9c3516f2-7a40-4949-a444-3c4f7a70fe89 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:03.435679 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9c3516f2-7a40-4949-a444-3c4f7a70fe89 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:03.517527 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-5ac35310-be13-4f10-ad69-f19831837983 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:03.524816 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-5ac35310-be13-4f10-ad69-f19831837983 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.166510 Dec 20 09:33:03.525382 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 344/722] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:03 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:04.541102 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-41a4f60b-1462-4514-93dd-7e606f8103da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:04.541700 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-41a4f60b-1462-4514-93dd-7e606f8103da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:04.547846 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-41a4f60b-1462-4514-93dd-7e606f8103da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:04.548292 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-41a4f60b-1462-4514-93dd-7e606f8103da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:04.549058 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-41a4f60b-1462-4514-93dd-7e606f8103da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:04.549487 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-41a4f60b-1462-4514-93dd-7e606f8103da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:04.710068 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-41a4f60b-1462-4514-93dd-7e606f8103da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:04.717440 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-41a4f60b-1462-4514-93dd-7e606f8103da tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.179946 Dec 20 09:33:04.718720 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 345/723] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:04 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:05.734717 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-cc9137ad-b4fa-4d02-8308-afa781efff77 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:05.735460 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-cc9137ad-b4fa-4d02-8308-afa781efff77 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:05.742055 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cc9137ad-b4fa-4d02-8308-afa781efff77 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:05.742581 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cc9137ad-b4fa-4d02-8308-afa781efff77 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:05.743372 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cc9137ad-b4fa-4d02-8308-afa781efff77 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:05.743842 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cc9137ad-b4fa-4d02-8308-afa781efff77 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:05.874511 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-cc9137ad-b4fa-4d02-8308-afa781efff77 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:05.881864 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-cc9137ad-b4fa-4d02-8308-afa781efff77 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.151452 Dec 20 09:33:05.882433 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 346/724] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:05 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:06.898170 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-bd6d8d82-6ad2-4f98-aef1-d0d6af337e17 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:06.898843 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-bd6d8d82-6ad2-4f98-aef1-d0d6af337e17 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:06.906533 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bd6d8d82-6ad2-4f98-aef1-d0d6af337e17 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:06.907033 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bd6d8d82-6ad2-4f98-aef1-d0d6af337e17 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:06.907908 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bd6d8d82-6ad2-4f98-aef1-d0d6af337e17 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:06.908349 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bd6d8d82-6ad2-4f98-aef1-d0d6af337e17 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:07.053206 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-bd6d8d82-6ad2-4f98-aef1-d0d6af337e17 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:07.060683 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-bd6d8d82-6ad2-4f98-aef1-d0d6af337e17 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.166140 Dec 20 09:33:07.061258 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 347/725] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:06 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:07.575355 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9c3516f2-7a40-4949-a444-3c4f7a70fe89 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 200 len: 38300 microversion: 2.20 time: 4.174444 Dec 20 09:33:07.576611 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 379/726] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:33:03 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 38300 bytes in 4177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:33:07.585496 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f0160b51-1266-4741-89f9-6792e59c9b17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:07.586220 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f0160b51-1266-4741-89f9-6792e59c9b17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:07.592280 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f0160b51-1266-4741-89f9-6792e59c9b17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:07.592755 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f0160b51-1266-4741-89f9-6792e59c9b17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:07.593929 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f0160b51-1266-4741-89f9-6792e59c9b17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:07.594691 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f0160b51-1266-4741-89f9-6792e59c9b17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:07.620828 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f0160b51-1266-4741-89f9-6792e59c9b17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/ips" status: 200 len: 151 microversion: 2.20 time: 0.038893 Dec 20 09:33:07.621720 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 348/727] 10.222.0.62 () {60 vars in 1288 bytes} [Mon Dec 20 09:33:07 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:33:08.078753 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-86269609-b552-4eb0-801a-0fb6cd0aff50 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:08.079968 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-86269609-b552-4eb0-801a-0fb6cd0aff50 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:08.103699 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-86269609-b552-4eb0-801a-0fb6cd0aff50 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:08.106706 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-86269609-b552-4eb0-801a-0fb6cd0aff50 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:08.110793 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-86269609-b552-4eb0-801a-0fb6cd0aff50 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:08.110793 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-86269609-b552-4eb0-801a-0fb6cd0aff50 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:08.399478 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-86269609-b552-4eb0-801a-0fb6cd0aff50 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:08.407116 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-86269609-b552-4eb0-801a-0fb6cd0aff50 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1521 microversion: 2.1 time: 0.332312 Dec 20 09:33:08.408037 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 380/728] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:08 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:09.378810 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-8c0389f4-d9ec-45b9-b519-fcaaef3ba3bc req-13243c2d-860a-4edd-9215-b2da6052dbce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af8e934-5860-485f-abf5-42a2814d66e7", "name": "network-vif-deleted", "tag": "400b05c3-3434-415b-b982-6014d3a882ac"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:33:09.383897 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:33:09.383897 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:33:09.389024 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-8c0389f4-d9ec-45b9-b519-fcaaef3ba3bc req-13243c2d-860a-4edd-9215-b2da6052dbce service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:09.390080 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-8c0389f4-d9ec-45b9-b519-fcaaef3ba3bc req-13243c2d-860a-4edd-9215-b2da6052dbce service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:09.402683 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-8c0389f4-d9ec-45b9-b519-fcaaef3ba3bc req-13243c2d-860a-4edd-9215-b2da6052dbce service nova] Creating event network-vif-deleted:400b05c3-3434-415b-b982-6014d3a882ac for instance 1af8e934-5860-485f-abf5-42a2814d66e7 on hv-cinder-81908 Dec 20 09:33:09.408511 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-8c0389f4-d9ec-45b9-b519-fcaaef3ba3bc req-13243c2d-860a-4edd-9215-b2da6052dbce service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034193 Dec 20 09:33:09.409115 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 349/729] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:33:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:33:09.424034 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-98846850-e7f7-4039-ad35-45c34c9ac696 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:09.425247 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-98846850-e7f7-4039-ad35-45c34c9ac696 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:09.432303 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-98846850-e7f7-4039-ad35-45c34c9ac696 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:09.432960 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-98846850-e7f7-4039-ad35-45c34c9ac696 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:09.433934 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-98846850-e7f7-4039-ad35-45c34c9ac696 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:09.434533 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-98846850-e7f7-4039-ad35-45c34c9ac696 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:09.746125 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-98846850-e7f7-4039-ad35-45c34c9ac696 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01ea99da66c4fc488bf6db0e03a3dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a71a458922842fa8e71a3dbc317ab9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:09.753950 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-98846850-e7f7-4039-ad35-45c34c9ac696 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 200 len: 1479 microversion: 2.1 time: 0.333601 Dec 20 09:33:09.763630 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 381/730] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:09 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 1479 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:10.770718 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1de34e25-cba0-4f0c-aa84-3d1d9d4f8365 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:10.771368 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1de34e25-cba0-4f0c-aa84-3d1d9d4f8365 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] [instance: 1af8e934-5860-485f-abf5-42a2814d66e7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:10.778199 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1de34e25-cba0-4f0c-aa84-3d1d9d4f8365 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:10.778647 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1de34e25-cba0-4f0c-aa84-3d1d9d4f8365 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:10.779426 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1de34e25-cba0-4f0c-aa84-3d1d9d4f8365 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:10.779887 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1de34e25-cba0-4f0c-aa84-3d1d9d4f8365 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:10.795109 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-1de34e25-cba0-4f0c-aa84-3d1d9d4f8365 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] HTTP exception thrown: Instance 1af8e934-5860-485f-abf5-42a2814d66e7 could not be found. Dec 20 09:33:10.796262 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1de34e25-cba0-4f0c-aa84-3d1d9d4f8365 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] Returning 404 to user: Instance 1af8e934-5860-485f-abf5-42a2814d66e7 could not be found. {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:33:10.797086 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1de34e25-cba0-4f0c-aa84-3d1d9d4f8365 tempest-ServerRescueNegativeTestJSON-2000863212 tempest-ServerRescueNegativeTestJSON-2000863212-project] 10.222.0.62 "GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7" status: 404 len: 111 microversion: 2.1 time: 0.030433 Dec 20 09:33:10.797728 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 350/731] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:10 2021] GET /compute/v2.1/servers/1af8e934-5860-485f-abf5-42a2814d66e7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:33:11.034129 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-df2a9559-b6c5-4808-918c-ec45c7551f35 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:11.034650 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-df2a9559-b6c5-4808-918c-ec45c7551f35 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:11.040885 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-df2a9559-b6c5-4808-918c-ec45c7551f35 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:11.041321 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-df2a9559-b6c5-4808-918c-ec45c7551f35 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:11.042122 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-df2a9559-b6c5-4808-918c-ec45c7551f35 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:11.042546 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-df2a9559-b6c5-4808-918c-ec45c7551f35 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:11.168538 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.objects.instance [None req-df2a9559-b6c5-4808-918c-ec45c7551f35 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lazy-loading 'services' on Instance uuid 399b91a8-a248-4272-806a-cbfb84e66313 {{(pid=116674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:33:11.390637 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-df2a9559-b6c5-4808-918c-ec45c7551f35 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "DELETE /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313/os-volume_attachments/334c5971-e69f-48f3-afd5-d70831bfba2f" status: 202 len: 0 microversion: 2.1 time: 0.360538 Dec 20 09:33:11.394985 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 382/732] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 20 09:33:11 2021] DELETE /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313/os-volume_attachments/334c5971-e69f-48f3-afd5-d70831bfba2f => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:33:11.401342 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-7fcd56cb-dff1-451c-a1cc-ba7d0915c4ac tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:11.402449 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-7fcd56cb-dff1-451c-a1cc-ba7d0915c4ac tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:11.415150 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7fcd56cb-dff1-451c-a1cc-ba7d0915c4ac tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:11.415796 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7fcd56cb-dff1-451c-a1cc-ba7d0915c4ac tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:11.416580 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7fcd56cb-dff1-451c-a1cc-ba7d0915c4ac tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:11.417012 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7fcd56cb-dff1-451c-a1cc-ba7d0915c4ac tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:11.461597 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-7fcd56cb-dff1-451c-a1cc-ba7d0915c4ac tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065361 Dec 20 09:33:11.462919 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 351/733] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:33:11 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:33:12.476217 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-2cb998d0-86da-40ea-9420-f791e12149bd tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:12.477926 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-2cb998d0-86da-40ea-9420-f791e12149bd tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:12.485311 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2cb998d0-86da-40ea-9420-f791e12149bd tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:12.485853 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2cb998d0-86da-40ea-9420-f791e12149bd tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:12.486952 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2cb998d0-86da-40ea-9420-f791e12149bd tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:12.487461 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2cb998d0-86da-40ea-9420-f791e12149bd tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:12.540261 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-2cb998d0-86da-40ea-9420-f791e12149bd tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067043 Dec 20 09:33:12.543060 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 383/734] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:33:12 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:33:13.550228 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-374cefef-c0ca-4aef-b98f-9658b3c9a989 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:13.551293 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-374cefef-c0ca-4aef-b98f-9658b3c9a989 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:13.558457 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-374cefef-c0ca-4aef-b98f-9658b3c9a989 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:13.559028 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-374cefef-c0ca-4aef-b98f-9658b3c9a989 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:13.559933 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-374cefef-c0ca-4aef-b98f-9658b3c9a989 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:13.560596 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-374cefef-c0ca-4aef-b98f-9658b3c9a989 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:13.628616 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-374cefef-c0ca-4aef-b98f-9658b3c9a989 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079164 Dec 20 09:33:13.629585 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 352/735] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:33:13 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:33:14.642778 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-6f2ac9e8-1e4c-41c3-8b60-ae3ea9d3cd4f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:14.644669 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-6f2ac9e8-1e4c-41c3-8b60-ae3ea9d3cd4f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:14.661115 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6f2ac9e8-1e4c-41c3-8b60-ae3ea9d3cd4f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:14.667800 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6f2ac9e8-1e4c-41c3-8b60-ae3ea9d3cd4f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:14.667800 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6f2ac9e8-1e4c-41c3-8b60-ae3ea9d3cd4f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:14.667800 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6f2ac9e8-1e4c-41c3-8b60-ae3ea9d3cd4f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:14.702923 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-6f2ac9e8-1e4c-41c3-8b60-ae3ea9d3cd4f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064672 Dec 20 09:33:14.707393 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 384/736] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:33:14 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:33:14.918477 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c8bad9d2-ab3a-4731-9706-7deacc34f273 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:33:14.918997 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c8bad9d2-ab3a-4731-9706-7deacc34f273 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:14.925864 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c8bad9d2-ab3a-4731-9706-7deacc34f273 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:14.926318 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c8bad9d2-ab3a-4731-9706-7deacc34f273 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:14.927144 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c8bad9d2-ab3a-4731-9706-7deacc34f273 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:14.927523 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c8bad9d2-ab3a-4731-9706-7deacc34f273 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:14.956811 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.objects.instance [None req-c8bad9d2-ab3a-4731-9706-7deacc34f273 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lazy-loading 'flavor' on Instance uuid c9ba0eda-fab4-44dc-b41f-0c51574dca1f {{(pid=116675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:33:15.718335 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-78cf2b51-a0bd-42c2-b280-0b2ff8bb7f6f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:15.724744 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-78cf2b51-a0bd-42c2-b280-0b2ff8bb7f6f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:15.729983 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-78cf2b51-a0bd-42c2-b280-0b2ff8bb7f6f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:15.732331 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-78cf2b51-a0bd-42c2-b280-0b2ff8bb7f6f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:15.733925 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-78cf2b51-a0bd-42c2-b280-0b2ff8bb7f6f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:15.736197 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-78cf2b51-a0bd-42c2-b280-0b2ff8bb7f6f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:15.804572 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-78cf2b51-a0bd-42c2-b280-0b2ff8bb7f6f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093822 Dec 20 09:33:15.806761 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 385/737] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:33:15 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:33:16.040903 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c8bad9d2-ab3a-4731-9706-7deacc34f273 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 202 len: 0 microversion: 2.20 time: 1.125408 Dec 20 09:33:16.042476 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 353/738] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:33:14 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 0 bytes in 1128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 20 09:33:16.051877 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e4657d3e-21cb-4c11-9f4e-633d7e56130a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:16.052786 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e4657d3e-21cb-4c11-9f4e-633d7e56130a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:16.060060 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e4657d3e-21cb-4c11-9f4e-633d7e56130a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:16.070393 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e4657d3e-21cb-4c11-9f4e-633d7e56130a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:16.070393 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e4657d3e-21cb-4c11-9f4e-633d7e56130a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:16.070393 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e4657d3e-21cb-4c11-9f4e-633d7e56130a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:16.499578 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e4657d3e-21cb-4c11-9f4e-633d7e56130a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:16.513410 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e4657d3e-21cb-4c11-9f4e-633d7e56130a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:16.513410 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e4657d3e-21cb-4c11-9f4e-633d7e56130a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:16.513410 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e4657d3e-21cb-4c11-9f4e-633d7e56130a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1723 microversion: 2.20 time: 0.466276 Dec 20 09:33:16.513738 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 386/739] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:16 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1723 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:33:16.830031 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8f0c2a66-ce5a-4f32-94c9-af779e7030c1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:16.832347 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8f0c2a66-ce5a-4f32-94c9-af779e7030c1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:16.860001 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8f0c2a66-ce5a-4f32-94c9-af779e7030c1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:16.860542 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8f0c2a66-ce5a-4f32-94c9-af779e7030c1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:16.862284 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8f0c2a66-ce5a-4f32-94c9-af779e7030c1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:16.863402 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8f0c2a66-ce5a-4f32-94c9-af779e7030c1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:16.895546 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8f0c2a66-ce5a-4f32-94c9-af779e7030c1 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074599 Dec 20 09:33:16.896706 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 354/740] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:33:16 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:33:17.536785 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ed8cded6-5485-4b05-a720-b53b5f559a00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:17.537396 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ed8cded6-5485-4b05-a720-b53b5f559a00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:17.544716 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ed8cded6-5485-4b05-a720-b53b5f559a00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:17.544716 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ed8cded6-5485-4b05-a720-b53b5f559a00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:17.551758 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ed8cded6-5485-4b05-a720-b53b5f559a00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:17.553692 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ed8cded6-5485-4b05-a720-b53b5f559a00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:17.735137 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ed8cded6-5485-4b05-a720-b53b5f559a00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:17.743926 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ed8cded6-5485-4b05-a720-b53b5f559a00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:17.745459 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ed8cded6-5485-4b05-a720-b53b5f559a00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:17.746697 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ed8cded6-5485-4b05-a720-b53b5f559a00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1723 microversion: 2.20 time: 0.218814 Dec 20 09:33:17.747400 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 387/741] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:17 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:33:17.907263 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-de60f7af-d2aa-4fef-921a-cd053484b90c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:17.911817 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-de60f7af-d2aa-4fef-921a-cd053484b90c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:17.918089 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-de60f7af-d2aa-4fef-921a-cd053484b90c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:17.918538 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-de60f7af-d2aa-4fef-921a-cd053484b90c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:17.920191 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-de60f7af-d2aa-4fef-921a-cd053484b90c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:17.921583 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-de60f7af-d2aa-4fef-921a-cd053484b90c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:17.958828 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-de60f7af-d2aa-4fef-921a-cd053484b90c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056001 Dec 20 09:33:17.959971 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 355/742] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:33:17 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 09:33:18.770132 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-10aa8184-29c7-4815-96e4-2b21a6d2ddc4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:18.770851 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-10aa8184-29c7-4815-96e4-2b21a6d2ddc4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:18.776921 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-10aa8184-29c7-4815-96e4-2b21a6d2ddc4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:18.777367 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-10aa8184-29c7-4815-96e4-2b21a6d2ddc4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:18.778154 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-10aa8184-29c7-4815-96e4-2b21a6d2ddc4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:18.778592 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-10aa8184-29c7-4815-96e4-2b21a6d2ddc4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:19.018094 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-10aa8184-29c7-4815-96e4-2b21a6d2ddc4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:19.027897 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-10aa8184-29c7-4815-96e4-2b21a6d2ddc4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:19.030287 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-10aa8184-29c7-4815-96e4-2b21a6d2ddc4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:19.031901 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-10aa8184-29c7-4815-96e4-2b21a6d2ddc4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1723 microversion: 2.20 time: 0.271154 Dec 20 09:33:19.043972 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 388/743] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:18 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:33:19.333595 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-367c7a15-52b9-45b3-9761-38196e889186 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:19.334052 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-367c7a15-52b9-45b3-9761-38196e889186 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:19.344534 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-367c7a15-52b9-45b3-9761-38196e889186 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:19.344989 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-367c7a15-52b9-45b3-9761-38196e889186 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:19.345834 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-367c7a15-52b9-45b3-9761-38196e889186 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:19.346276 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-367c7a15-52b9-45b3-9761-38196e889186 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:19.419747 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-367c7a15-52b9-45b3-9761-38196e889186 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Going to try to terminate instance {{(pid=116675) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 09:33:19.823735 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-367c7a15-52b9-45b3-9761-38196e889186 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "DELETE /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 204 len: 0 microversion: 2.1 time: 0.494715 Dec 20 09:33:19.824321 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 356/744] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 20 09:33:19 2021] DELETE /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 09:33:19.836675 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4e44e576-820b-4c87-96ab-95682570aad5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:19.838245 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-4e44e576-820b-4c87-96ab-95682570aad5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:19.850376 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4e44e576-820b-4c87-96ab-95682570aad5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:19.851145 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4e44e576-820b-4c87-96ab-95682570aad5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:19.852200 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4e44e576-820b-4c87-96ab-95682570aad5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:19.852998 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4e44e576-820b-4c87-96ab-95682570aad5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:20.061872 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-afebb076-0b0e-4117-99bb-9e81d12fe0b7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:20.064994 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-afebb076-0b0e-4117-99bb-9e81d12fe0b7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:20.084126 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-afebb076-0b0e-4117-99bb-9e81d12fe0b7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:20.088256 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-afebb076-0b0e-4117-99bb-9e81d12fe0b7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:20.094198 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-afebb076-0b0e-4117-99bb-9e81d12fe0b7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:20.094198 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-afebb076-0b0e-4117-99bb-9e81d12fe0b7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:20.143396 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-4e44e576-820b-4c87-96ab-95682570aad5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:20.150800 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-4e44e576-820b-4c87-96ab-95682570aad5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1513 microversion: 2.1 time: 0.322156 Dec 20 09:33:20.157885 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 389/745] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:19 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1513 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:20.549233 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-afebb076-0b0e-4117-99bb-9e81d12fe0b7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:20.565400 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-afebb076-0b0e-4117-99bb-9e81d12fe0b7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:20.567274 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-afebb076-0b0e-4117-99bb-9e81d12fe0b7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:20.568660 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-afebb076-0b0e-4117-99bb-9e81d12fe0b7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1723 microversion: 2.20 time: 0.518637 Dec 20 09:33:20.569940 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 357/746] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:20 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1723 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:33:20.806769 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-fc1a342e-5b3f-46b0-8eac-c91816f4798a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:20.807267 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-fc1a342e-5b3f-46b0-8eac-c91816f4798a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:20.820172 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fc1a342e-5b3f-46b0-8eac-c91816f4798a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:20.820939 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fc1a342e-5b3f-46b0-8eac-c91816f4798a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:20.821820 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fc1a342e-5b3f-46b0-8eac-c91816f4798a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:20.822725 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fc1a342e-5b3f-46b0-8eac-c91816f4798a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:20.979142 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.objects.instance [None req-fc1a342e-5b3f-46b0-8eac-c91816f4798a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lazy-loading 'services' on Instance uuid 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf {{(pid=116674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:33:21.179723 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-06dacfef-11e6-44e8-b72f-c1ae8999124d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:21.180732 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-06dacfef-11e6-44e8-b72f-c1ae8999124d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:21.202191 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-06dacfef-11e6-44e8-b72f-c1ae8999124d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:21.203143 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-06dacfef-11e6-44e8-b72f-c1ae8999124d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:21.204495 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-06dacfef-11e6-44e8-b72f-c1ae8999124d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:21.205140 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-06dacfef-11e6-44e8-b72f-c1ae8999124d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:21.372603 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-fc1a342e-5b3f-46b0-8eac-c91816f4798a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf/os-volume_attachments/81964746-a4ed-4ab5-8ec0-4dfd0b50a73a" status: 202 len: 0 microversion: 2.1 time: 0.569421 Dec 20 09:33:21.373839 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 390/747] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 20 09:33:20 2021] DELETE /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf/os-volume_attachments/81964746-a4ed-4ab5-8ec0-4dfd0b50a73a => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:33:21.555477 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-06dacfef-11e6-44e8-b72f-c1ae8999124d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:21.566714 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-06dacfef-11e6-44e8-b72f-c1ae8999124d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1513 microversion: 2.1 time: 0.390799 Dec 20 09:33:21.568420 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 358/748] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:21 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1513 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:21.586765 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-896a8de1-96ad-4ba7-b53a-604999b50528 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:21.587471 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-896a8de1-96ad-4ba7-b53a-604999b50528 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:21.605911 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-896a8de1-96ad-4ba7-b53a-604999b50528 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:21.608128 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-896a8de1-96ad-4ba7-b53a-604999b50528 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:21.608978 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-896a8de1-96ad-4ba7-b53a-604999b50528 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:21.609425 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-896a8de1-96ad-4ba7-b53a-604999b50528 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:21.870634 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-896a8de1-96ad-4ba7-b53a-604999b50528 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:21.883940 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-896a8de1-96ad-4ba7-b53a-604999b50528 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:21.886663 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-896a8de1-96ad-4ba7-b53a-604999b50528 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:21.888146 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-896a8de1-96ad-4ba7-b53a-604999b50528 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1723 microversion: 2.20 time: 0.305544 Dec 20 09:33:21.909996 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 391/749] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:21 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:33:22.583491 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f8ed1c0d-5b78-4c1e-9b69-ef26a46d6692 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:22.587105 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f8ed1c0d-5b78-4c1e-9b69-ef26a46d6692 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:22.599545 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f8ed1c0d-5b78-4c1e-9b69-ef26a46d6692 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:22.603582 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f8ed1c0d-5b78-4c1e-9b69-ef26a46d6692 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:22.604809 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f8ed1c0d-5b78-4c1e-9b69-ef26a46d6692 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:22.605476 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f8ed1c0d-5b78-4c1e-9b69-ef26a46d6692 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:22.899544 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f8ed1c0d-5b78-4c1e-9b69-ef26a46d6692 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:22.911609 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f8ed1c0d-5b78-4c1e-9b69-ef26a46d6692 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1513 microversion: 2.1 time: 0.330324 Dec 20 09:33:22.912236 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 359/750] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:22 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1513 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:22.920877 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b36c6fa2-90bf-4cff-b99d-36665cc8e71e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:22.920877 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b36c6fa2-90bf-4cff-b99d-36665cc8e71e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:22.923109 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b36c6fa2-90bf-4cff-b99d-36665cc8e71e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:22.923690 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b36c6fa2-90bf-4cff-b99d-36665cc8e71e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:22.927179 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b36c6fa2-90bf-4cff-b99d-36665cc8e71e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:22.927179 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b36c6fa2-90bf-4cff-b99d-36665cc8e71e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:23.159265 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b36c6fa2-90bf-4cff-b99d-36665cc8e71e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:23.168990 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b36c6fa2-90bf-4cff-b99d-36665cc8e71e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:23.170772 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b36c6fa2-90bf-4cff-b99d-36665cc8e71e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:23.172314 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b36c6fa2-90bf-4cff-b99d-36665cc8e71e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1723 microversion: 2.20 time: 0.262945 Dec 20 09:33:23.173543 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 392/751] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:22 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:33:23.756708 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-93e1e054-fd3e-4e1f-9492-b9527b1acf85 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:23.757325 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-93e1e054-fd3e-4e1f-9492-b9527b1acf85 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:23.774911 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-93e1e054-fd3e-4e1f-9492-b9527b1acf85 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:23.775943 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-93e1e054-fd3e-4e1f-9492-b9527b1acf85 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:23.777346 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-93e1e054-fd3e-4e1f-9492-b9527b1acf85 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:23.777952 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-93e1e054-fd3e-4e1f-9492-b9527b1acf85 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:23.839351 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-93e1e054-fd3e-4e1f-9492-b9527b1acf85 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Going to try to terminate instance {{(pid=116675) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 09:33:23.928620 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0929925f-bc51-49b8-8973-d0b05f298c16 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:23.929146 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0929925f-bc51-49b8-8973-d0b05f298c16 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:23.950185 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0929925f-bc51-49b8-8973-d0b05f298c16 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:23.950644 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0929925f-bc51-49b8-8973-d0b05f298c16 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:23.952026 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0929925f-bc51-49b8-8973-d0b05f298c16 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:23.952469 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0929925f-bc51-49b8-8973-d0b05f298c16 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:24.080742 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-0929925f-bc51-49b8-8973-d0b05f298c16 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:24.089567 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0929925f-bc51-49b8-8973-d0b05f298c16 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1471 microversion: 2.1 time: 0.164529 Dec 20 09:33:24.090427 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 393/752] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:23 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:24.104488 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-773dfbdd-738a-47ca-89f6-f8dcab065d36 req-6cf9a5ad-9913-4e55-a66d-0c20f3b864cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "399b91a8-a248-4272-806a-cbfb84e66313", "name": "network-vif-deleted", "tag": "f9f613bc-e935-42ad-9672-010d478a8336"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:33:24.106747 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:33:24.106747 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:33:24.115900 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-773dfbdd-738a-47ca-89f6-f8dcab065d36 req-6cf9a5ad-9913-4e55-a66d-0c20f3b864cc service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:24.116517 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-773dfbdd-738a-47ca-89f6-f8dcab065d36 req-6cf9a5ad-9913-4e55-a66d-0c20f3b864cc service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:24.130217 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-773dfbdd-738a-47ca-89f6-f8dcab065d36 req-6cf9a5ad-9913-4e55-a66d-0c20f3b864cc service nova] Creating event network-vif-deleted:f9f613bc-e935-42ad-9672-010d478a8336 for instance 399b91a8-a248-4272-806a-cbfb84e66313 on hv-cinder-81908 Dec 20 09:33:24.136277 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-773dfbdd-738a-47ca-89f6-f8dcab065d36 req-6cf9a5ad-9913-4e55-a66d-0c20f3b864cc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043945 Dec 20 09:33:24.137618 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 394/753] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:33:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:33:24.198879 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-22bcf7dd-7f51-4888-af9b-be512c291046 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:24.199587 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-22bcf7dd-7f51-4888-af9b-be512c291046 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:24.231120 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-22bcf7dd-7f51-4888-af9b-be512c291046 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:24.233299 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-22bcf7dd-7f51-4888-af9b-be512c291046 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:24.236672 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-22bcf7dd-7f51-4888-af9b-be512c291046 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:24.240904 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-22bcf7dd-7f51-4888-af9b-be512c291046 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:24.310256 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-93e1e054-fd3e-4e1f-9492-b9527b1acf85 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 204 len: 0 microversion: 2.1 time: 0.559717 Dec 20 09:33:24.314851 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 360/754] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 20 09:33:23 2021] DELETE /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 09:33:24.325694 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-3c34712a-6059-4d33-8e29-a794ad9a24b9 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:24.335352 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-3c34712a-6059-4d33-8e29-a794ad9a24b9 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:24.375754 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3c34712a-6059-4d33-8e29-a794ad9a24b9 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:24.376167 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3c34712a-6059-4d33-8e29-a794ad9a24b9 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:24.386839 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3c34712a-6059-4d33-8e29-a794ad9a24b9 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:24.387454 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3c34712a-6059-4d33-8e29-a794ad9a24b9 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:24.602048 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-22bcf7dd-7f51-4888-af9b-be512c291046 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:24.614716 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-22bcf7dd-7f51-4888-af9b-be512c291046 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:24.618019 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-22bcf7dd-7f51-4888-af9b-be512c291046 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:24.619318 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-22bcf7dd-7f51-4888-af9b-be512c291046 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1723 microversion: 2.20 time: 0.431466 Dec 20 09:33:24.631544 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 395/755] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:24 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1723 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:33:24.704438 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-3c34712a-6059-4d33-8e29-a794ad9a24b9 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:24.715375 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-3c34712a-6059-4d33-8e29-a794ad9a24b9 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1512 microversion: 2.1 time: 0.395259 Dec 20 09:33:24.719744 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 361/756] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:24 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1512 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:25.106314 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5daa9130-b814-474f-b81f-47ee4d56074e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:25.106939 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-5daa9130-b814-474f-b81f-47ee4d56074e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:25.113764 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5daa9130-b814-474f-b81f-47ee4d56074e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:25.114408 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5daa9130-b814-474f-b81f-47ee4d56074e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:25.115246 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5daa9130-b814-474f-b81f-47ee4d56074e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:25.115714 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5daa9130-b814-474f-b81f-47ee4d56074e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:25.154126 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5daa9130-b814-474f-b81f-47ee4d56074e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:25.154604 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5daa9130-b814-474f-b81f-47ee4d56074e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:25.155056 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.objects.instance [None req-5daa9130-b814-474f-b81f-47ee4d56074e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lazy-loading 'fault' on Instance uuid 399b91a8-a248-4272-806a-cbfb84e66313 {{(pid=116674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:33:25.481511 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-5daa9130-b814-474f-b81f-47ee4d56074e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:25.496065 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-5daa9130-b814-474f-b81f-47ee4d56074e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 200 len: 1307 microversion: 2.1 time: 0.393121 Dec 20 09:33:25.497133 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 396/757] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:25 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 1307 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:25.637906 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-51a96c3b-f441-441f-afda-0b5f035a72dd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:25.639873 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-51a96c3b-f441-441f-afda-0b5f035a72dd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:25.648187 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-51a96c3b-f441-441f-afda-0b5f035a72dd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:25.652653 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-51a96c3b-f441-441f-afda-0b5f035a72dd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:25.653707 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-51a96c3b-f441-441f-afda-0b5f035a72dd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:25.658451 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-51a96c3b-f441-441f-afda-0b5f035a72dd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:25.732785 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-37032c79-704d-42df-8324-7498b1820e82 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:25.733649 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-37032c79-704d-42df-8324-7498b1820e82 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:25.749586 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37032c79-704d-42df-8324-7498b1820e82 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:25.750329 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37032c79-704d-42df-8324-7498b1820e82 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:25.751353 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37032c79-704d-42df-8324-7498b1820e82 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:25.752019 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37032c79-704d-42df-8324-7498b1820e82 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:25.979245 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-51a96c3b-f441-441f-afda-0b5f035a72dd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:25.993313 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-51a96c3b-f441-441f-afda-0b5f035a72dd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:25.994787 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-51a96c3b-f441-441f-afda-0b5f035a72dd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:26.001976 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-51a96c3b-f441-441f-afda-0b5f035a72dd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1723 microversion: 2.20 time: 0.367867 Dec 20 09:33:26.012481 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 362/758] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:25 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1723 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:33:26.089076 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-37032c79-704d-42df-8324-7498b1820e82 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:26.097924 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-37032c79-704d-42df-8324-7498b1820e82 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1512 microversion: 2.1 time: 0.368856 Dec 20 09:33:26.099317 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 397/759] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:25 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1512 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:26.513510 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4de72749-5cb7-4d7f-ab55-b7286298dd86 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:26.515437 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4de72749-5cb7-4d7f-ab55-b7286298dd86 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 399b91a8-a248-4272-806a-cbfb84e66313] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:26.524914 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4de72749-5cb7-4d7f-ab55-b7286298dd86 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:26.525738 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4de72749-5cb7-4d7f-ab55-b7286298dd86 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:26.527036 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4de72749-5cb7-4d7f-ab55-b7286298dd86 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:26.528366 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4de72749-5cb7-4d7f-ab55-b7286298dd86 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:26.559190 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-4de72749-5cb7-4d7f-ab55-b7286298dd86 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] HTTP exception thrown: Instance 399b91a8-a248-4272-806a-cbfb84e66313 could not be found. Dec 20 09:33:26.559945 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4de72749-5cb7-4d7f-ab55-b7286298dd86 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Returning 404 to user: Instance 399b91a8-a248-4272-806a-cbfb84e66313 could not be found. {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:33:26.560975 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4de72749-5cb7-4d7f-ab55-b7286298dd86 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313" status: 404 len: 111 microversion: 2.1 time: 0.051232 Dec 20 09:33:26.562063 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 363/760] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:26 2021] GET /compute/v2.1/servers/399b91a8-a248-4272-806a-cbfb84e66313 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:33:27.021927 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d3472300-69fe-4fb2-888b-18db9b302ca4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:27.023871 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d3472300-69fe-4fb2-888b-18db9b302ca4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:27.039844 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d3472300-69fe-4fb2-888b-18db9b302ca4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:27.040527 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d3472300-69fe-4fb2-888b-18db9b302ca4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:27.041573 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d3472300-69fe-4fb2-888b-18db9b302ca4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:27.042170 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d3472300-69fe-4fb2-888b-18db9b302ca4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:27.118235 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-425c1157-d226-437d-963b-522ff2dfd898 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:27.119825 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-425c1157-d226-437d-963b-522ff2dfd898 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:27.132837 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-425c1157-d226-437d-963b-522ff2dfd898 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:27.134637 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-425c1157-d226-437d-963b-522ff2dfd898 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:27.135743 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-425c1157-d226-437d-963b-522ff2dfd898 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:27.139977 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-425c1157-d226-437d-963b-522ff2dfd898 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:27.590928 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d3472300-69fe-4fb2-888b-18db9b302ca4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:27.616992 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d3472300-69fe-4fb2-888b-18db9b302ca4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:27.620354 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d3472300-69fe-4fb2-888b-18db9b302ca4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:27.626606 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d3472300-69fe-4fb2-888b-18db9b302ca4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1723 microversion: 2.20 time: 0.609244 Dec 20 09:33:27.627083 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 398/761] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:27 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1723 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:33:27.686118 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-425c1157-d226-437d-963b-522ff2dfd898 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:27.702697 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-425c1157-d226-437d-963b-522ff2dfd898 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1512 microversion: 2.1 time: 0.588210 Dec 20 09:33:27.706944 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 364/762] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:27 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1512 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:27.950421 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-63d76dbf-6ef0-4e75-8f4c-3d2b652e259a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:27.953851 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-29ac0d35-5d1d-486b-901a-39edb8d1146a req-def4e784-af5f-4264-b848-9c81a9c2a816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd9e0f3-3b58-47b2-a0cf-318133fa48cf", "name": "network-vif-deleted", "tag": "e104443e-dbfd-42a1-b9cb-fd04cb2169af"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:33:27.956092 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-63d76dbf-6ef0-4e75-8f4c-3d2b652e259a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:27.959141 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:33:27.959141 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:33:27.977581 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-63d76dbf-6ef0-4e75-8f4c-3d2b652e259a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:27.983800 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-29ac0d35-5d1d-486b-901a-39edb8d1146a req-def4e784-af5f-4264-b848-9c81a9c2a816 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:27.984477 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-63d76dbf-6ef0-4e75-8f4c-3d2b652e259a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:27.985446 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-63d76dbf-6ef0-4e75-8f4c-3d2b652e259a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:27.985957 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-63d76dbf-6ef0-4e75-8f4c-3d2b652e259a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:27.989400 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-29ac0d35-5d1d-486b-901a-39edb8d1146a req-def4e784-af5f-4264-b848-9c81a9c2a816 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:28.011208 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-29ac0d35-5d1d-486b-901a-39edb8d1146a req-def4e784-af5f-4264-b848-9c81a9c2a816 service nova] Creating event network-vif-deleted:e104443e-dbfd-42a1-b9cb-fd04cb2169af for instance 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf on hv-cinder-81908 Dec 20 09:33:28.024312 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-29ac0d35-5d1d-486b-901a-39edb8d1146a req-def4e784-af5f-4264-b848-9c81a9c2a816 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082802 Dec 20 09:33:28.025313 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 365/763] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:33:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:33:28.052911 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-63d76dbf-6ef0-4e75-8f4c-3d2b652e259a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Going to try to terminate instance {{(pid=116674) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 09:33:28.449713 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-63d76dbf-6ef0-4e75-8f4c-3d2b652e259a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "DELETE /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 204 len: 0 microversion: 2.1 time: 0.513862 Dec 20 09:33:28.451695 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 399/764] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 20 09:33:27 2021] DELETE /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 09:33:28.459481 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2fd7a3e4-55ef-4352-b520-4f1892ded5c0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:28.460351 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2fd7a3e4-55ef-4352-b520-4f1892ded5c0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:28.479547 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2fd7a3e4-55ef-4352-b520-4f1892ded5c0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:28.480036 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2fd7a3e4-55ef-4352-b520-4f1892ded5c0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:28.480829 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2fd7a3e4-55ef-4352-b520-4f1892ded5c0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:28.481295 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2fd7a3e4-55ef-4352-b520-4f1892ded5c0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:28.660152 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5d23dc39-292b-4bea-8449-e3c2430a5d55 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:28.660152 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-5d23dc39-292b-4bea-8449-e3c2430a5d55 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:28.664051 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5d23dc39-292b-4bea-8449-e3c2430a5d55 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:28.664761 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5d23dc39-292b-4bea-8449-e3c2430a5d55 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:28.665871 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5d23dc39-292b-4bea-8449-e3c2430a5d55 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:28.666732 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5d23dc39-292b-4bea-8449-e3c2430a5d55 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:28.920737 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-2fd7a3e4-55ef-4352-b520-4f1892ded5c0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:28.933800 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2fd7a3e4-55ef-4352-b520-4f1892ded5c0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1514 microversion: 2.1 time: 0.477189 Dec 20 09:33:28.935000 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 366/765] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:28 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1514 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:28.947191 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-78e77a6c-477a-44b3-9a84-f7f5d4ea25c5 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:28.948774 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-78e77a6c-477a-44b3-9a84-f7f5d4ea25c5 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:28.956486 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-78e77a6c-477a-44b3-9a84-f7f5d4ea25c5 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:28.967175 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-78e77a6c-477a-44b3-9a84-f7f5d4ea25c5 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:28.967175 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-78e77a6c-477a-44b3-9a84-f7f5d4ea25c5 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:28.967175 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-78e77a6c-477a-44b3-9a84-f7f5d4ea25c5 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:28.978374 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-5d23dc39-292b-4bea-8449-e3c2430a5d55 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:28.987179 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-5d23dc39-292b-4bea-8449-e3c2430a5d55 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:28.988760 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-5d23dc39-292b-4bea-8449-e3c2430a5d55 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:28.994304 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-5d23dc39-292b-4bea-8449-e3c2430a5d55 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1723 microversion: 2.20 time: 0.352577 Dec 20 09:33:29.011759 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 400/766] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:28 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1723 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:33:29.026055 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-78e77a6c-477a-44b3-9a84-f7f5d4ea25c5 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:29.026768 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-78e77a6c-477a-44b3-9a84-f7f5d4ea25c5 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:29.027386 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.objects.instance [None req-78e77a6c-477a-44b3-9a84-f7f5d4ea25c5 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lazy-loading 'fault' on Instance uuid 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf {{(pid=116675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:33:29.069980 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-78e77a6c-477a-44b3-9a84-f7f5d4ea25c5 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:29.078330 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-78e77a6c-477a-44b3-9a84-f7f5d4ea25c5 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 200 len: 1308 microversion: 2.1 time: 0.140707 Dec 20 09:33:29.079832 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 367/767] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:28 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 1308 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:29.276611 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7acc7750-106a-404e-93c7-1b12ea59a0d8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'create', calling method: .version_select at 0x7f914e3b5820>, body: {"keypair": {"name": "tempest-keypair-773355402"}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:33:29.288560 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-7acc7750-106a-404e-93c7-1b12ea59a0d8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Getting quotas for project d5a528a79d2c4c94bd7b4a0b200b21f7. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:33:29.293291 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-7acc7750-106a-404e-93c7-1b12ea59a0d8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Getting quotas for user 52d81af5e27f434dba28295236ca39d0 and project d5a528a79d2c4c94bd7b4a0b200b21f7. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:33:29.954138 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6746cd35-888e-43cd-a42c-51c7f3c82fca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:29.954741 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6746cd35-888e-43cd-a42c-51c7f3c82fca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:29.961226 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6746cd35-888e-43cd-a42c-51c7f3c82fca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:29.971307 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6746cd35-888e-43cd-a42c-51c7f3c82fca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:29.972202 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6746cd35-888e-43cd-a42c-51c7f3c82fca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:29.972639 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6746cd35-888e-43cd-a42c-51c7f3c82fca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:30.024363 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-7acc7750-106a-404e-93c7-1b12ea59a0d8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Getting quotas for project d5a528a79d2c4c94bd7b4a0b200b21f7. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:33:30.028212 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-7acc7750-106a-404e-93c7-1b12ea59a0d8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Getting quotas for user 52d81af5e27f434dba28295236ca39d0 and project d5a528a79d2c4c94bd7b4a0b200b21f7. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:33:30.043163 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7acc7750-106a-404e-93c7-1b12ea59a0d8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.926014 Dec 20 09:33:30.050636 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 401/768] 10.222.0.62 () {60 vars in 1157 bytes} [Mon Dec 20 09:33:29 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:30.050636 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d0ff07a0-8703-4256-a073-19a044b93a83 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:30.050636 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d0ff07a0-8703-4256-a073-19a044b93a83 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:30.056310 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d0ff07a0-8703-4256-a073-19a044b93a83 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:30.056310 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d0ff07a0-8703-4256-a073-19a044b93a83 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:30.056530 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d0ff07a0-8703-4256-a073-19a044b93a83 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:30.056977 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d0ff07a0-8703-4256-a073-19a044b93a83 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:30.170452 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6746cd35-888e-43cd-a42c-51c7f3c82fca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:30.208338 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6746cd35-888e-43cd-a42c-51c7f3c82fca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1514 microversion: 2.1 time: 0.257737 Dec 20 09:33:30.209301 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 368/769] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:29 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1514 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:30.213925 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e767d455-d60b-4d18-a3fd-f3f9adeed4ae tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:30.214534 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e767d455-d60b-4d18-a3fd-f3f9adeed4ae tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:30.225071 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e767d455-d60b-4d18-a3fd-f3f9adeed4ae tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:30.225521 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e767d455-d60b-4d18-a3fd-f3f9adeed4ae tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:30.226317 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e767d455-d60b-4d18-a3fd-f3f9adeed4ae tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:30.226756 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e767d455-d60b-4d18-a3fd-f3f9adeed4ae tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:30.267240 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-e767d455-d60b-4d18-a3fd-f3f9adeed4ae tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] HTTP exception thrown: Instance 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf could not be found. Dec 20 09:33:30.271484 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e767d455-d60b-4d18-a3fd-f3f9adeed4ae tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Returning 404 to user: Instance 8dd9e0f3-3b58-47b2-a0cf-318133fa48cf could not be found. {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:33:30.272756 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e767d455-d60b-4d18-a3fd-f3f9adeed4ae tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf" status: 404 len: 111 microversion: 2.1 time: 0.062099 Dec 20 09:33:30.273338 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 369/770] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:30 2021] GET /compute/v2.1/servers/8dd9e0f3-3b58-47b2-a0cf-318133fa48cf => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:33:30.371270 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d0ff07a0-8703-4256-a073-19a044b93a83 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:30.388009 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d0ff07a0-8703-4256-a073-19a044b93a83 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:30.394075 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d0ff07a0-8703-4256-a073-19a044b93a83 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:30.397025 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d0ff07a0-8703-4256-a073-19a044b93a83 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1723 microversion: 2.20 time: 0.352225 Dec 20 09:33:30.397929 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 402/771] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:30 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1723 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:33:31.225353 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c1b9fa82-7099-416f-b3fc-626cb1b9c083 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:31.225962 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c1b9fa82-7099-416f-b3fc-626cb1b9c083 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:31.238771 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c1b9fa82-7099-416f-b3fc-626cb1b9c083 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:31.240239 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c1b9fa82-7099-416f-b3fc-626cb1b9c083 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:31.240239 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c1b9fa82-7099-416f-b3fc-626cb1b9c083 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:31.240449 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c1b9fa82-7099-416f-b3fc-626cb1b9c083 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:31.416046 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3c7d5041-a70a-4dd6-b4da-670bf8ff5f6c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:31.416657 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-3c7d5041-a70a-4dd6-b4da-670bf8ff5f6c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:31.424147 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3c7d5041-a70a-4dd6-b4da-670bf8ff5f6c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:31.424288 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3c7d5041-a70a-4dd6-b4da-670bf8ff5f6c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:31.439944 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3c7d5041-a70a-4dd6-b4da-670bf8ff5f6c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:31.440671 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3c7d5041-a70a-4dd6-b4da-670bf8ff5f6c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:31.572759 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-c1b9fa82-7099-416f-b3fc-626cb1b9c083 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:31.580871 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c1b9fa82-7099-416f-b3fc-626cb1b9c083 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1514 microversion: 2.1 time: 0.359068 Dec 20 09:33:31.590240 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 370/772] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:31 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1514 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:31.733449 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3c7d5041-a70a-4dd6-b4da-670bf8ff5f6c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:31.752130 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3c7d5041-a70a-4dd6-b4da-670bf8ff5f6c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:31.753868 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3c7d5041-a70a-4dd6-b4da-670bf8ff5f6c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:31.759063 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3c7d5041-a70a-4dd6-b4da-670bf8ff5f6c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1723 microversion: 2.20 time: 0.347344 Dec 20 09:33:31.769986 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 403/773] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:31 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1723 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:33:31.777846 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-d3ccebc0-e8cf-46dd-b847-b709357e5dc8 req-30e628a6-e4d4-4840-a41a-091feccb1c33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68a3fbd7-ef09-4f47-997e-918723eb5105", "name": "network-vif-deleted", "tag": "c79de5a3-3016-4906-8def-63e5bc5e12f8"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:33:31.780399 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:33:31.780399 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:33:31.789859 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-d3ccebc0-e8cf-46dd-b847-b709357e5dc8 req-30e628a6-e4d4-4840-a41a-091feccb1c33 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:31.790316 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-d3ccebc0-e8cf-46dd-b847-b709357e5dc8 req-30e628a6-e4d4-4840-a41a-091feccb1c33 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:31.813561 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-d3ccebc0-e8cf-46dd-b847-b709357e5dc8 req-30e628a6-e4d4-4840-a41a-091feccb1c33 service nova] Creating event network-vif-deleted:c79de5a3-3016-4906-8def-63e5bc5e12f8 for instance 68a3fbd7-ef09-4f47-997e-918723eb5105 on hv-cinder-81908 Dec 20 09:33:31.820365 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-d3ccebc0-e8cf-46dd-b847-b709357e5dc8 req-30e628a6-e4d4-4840-a41a-091feccb1c33 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047601 Dec 20 09:33:31.820966 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 371/774] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:33:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:33:32.599297 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7ed93903-e890-46f0-a3b0-03f98d2df4be tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:32.600781 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7ed93903-e890-46f0-a3b0-03f98d2df4be tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:32.608677 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7ed93903-e890-46f0-a3b0-03f98d2df4be tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:32.615998 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7ed93903-e890-46f0-a3b0-03f98d2df4be tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:32.617280 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7ed93903-e890-46f0-a3b0-03f98d2df4be tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:32.617884 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7ed93903-e890-46f0-a3b0-03f98d2df4be tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:32.678551 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7ed93903-e890-46f0-a3b0-03f98d2df4be tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:32.679598 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7ed93903-e890-46f0-a3b0-03f98d2df4be tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:32.680365 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.objects.instance [None req-7ed93903-e890-46f0-a3b0-03f98d2df4be tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lazy-loading 'fault' on Instance uuid 68a3fbd7-ef09-4f47-997e-918723eb5105 {{(pid=116674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:33:32.778234 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4beb5dae-e8c6-48b7-a999-f295ac018f36 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:32.780947 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4beb5dae-e8c6-48b7-a999-f295ac018f36 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:32.790490 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4beb5dae-e8c6-48b7-a999-f295ac018f36 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:32.791047 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4beb5dae-e8c6-48b7-a999-f295ac018f36 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:32.792127 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4beb5dae-e8c6-48b7-a999-f295ac018f36 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:32.792790 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4beb5dae-e8c6-48b7-a999-f295ac018f36 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:32.839188 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7ed93903-e890-46f0-a3b0-03f98d2df4be tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:32.847770 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7ed93903-e890-46f0-a3b0-03f98d2df4be tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1308 microversion: 2.1 time: 0.252989 Dec 20 09:33:32.848741 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 404/775] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:32 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1308 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:33.030835 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-4beb5dae-e8c6-48b7-a999-f295ac018f36 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:33.039131 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-4beb5dae-e8c6-48b7-a999-f295ac018f36 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:33.040898 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-4beb5dae-e8c6-48b7-a999-f295ac018f36 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:33.042034 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4beb5dae-e8c6-48b7-a999-f295ac018f36 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1723 microversion: 2.20 time: 0.268059 Dec 20 09:33:33.045650 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 372/776] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:32 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:33:33.864617 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-464eda22-9082-4e21-b394-6c5dd72caf97 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:33.865632 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-464eda22-9082-4e21-b394-6c5dd72caf97 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:33.871887 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-464eda22-9082-4e21-b394-6c5dd72caf97 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:33.872341 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-464eda22-9082-4e21-b394-6c5dd72caf97 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:33.873466 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-464eda22-9082-4e21-b394-6c5dd72caf97 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:33.881294 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-464eda22-9082-4e21-b394-6c5dd72caf97 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:33.901142 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-72642588-27b4-49d8-8806-98a67f771e0f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1978855454", "imageRef": "6f828f0b-c445-46a5-9960-492746785ef3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85d805f9-8f65-44aa-8b19-1203a8239e20"}], "security_groups": [{"name": "tempest-securitygroup--1524224358"}], "key_name": "tempest-keypair-773355402", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:33:33.941773 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-464eda22-9082-4e21-b394-6c5dd72caf97 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:33.942264 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-464eda22-9082-4e21-b394-6c5dd72caf97 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:33.942732 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.objects.instance [None req-464eda22-9082-4e21-b394-6c5dd72caf97 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lazy-loading 'fault' on Instance uuid 68a3fbd7-ef09-4f47-997e-918723eb5105 {{(pid=116674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:33:33.989722 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-464eda22-9082-4e21-b394-6c5dd72caf97 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:33.999918 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-464eda22-9082-4e21-b394-6c5dd72caf97 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1308 microversion: 2.1 time: 0.138932 Dec 20 09:33:34.000639 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 405/777] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:33 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1308 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:34.060863 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d9b4eee2-7818-4175-b241-226c794a1515 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:34.061762 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d9b4eee2-7818-4175-b241-226c794a1515 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:34.068163 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d9b4eee2-7818-4175-b241-226c794a1515 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:34.068605 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d9b4eee2-7818-4175-b241-226c794a1515 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:34.069408 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d9b4eee2-7818-4175-b241-226c794a1515 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:34.069840 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d9b4eee2-7818-4175-b241-226c794a1515 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:34.226362 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d9b4eee2-7818-4175-b241-226c794a1515 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:34.234724 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d9b4eee2-7818-4175-b241-226c794a1515 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:34.236356 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d9b4eee2-7818-4175-b241-226c794a1515 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:34.237514 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d9b4eee2-7818-4175-b241-226c794a1515 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1723 microversion: 2.20 time: 0.180620 Dec 20 09:33:34.238082 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 406/778] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:34 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:33:35.015605 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f9d07580-1e86-4d25-9f2a-5c93c636c1b7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:35.017035 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f9d07580-1e86-4d25-9f2a-5c93c636c1b7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:35.023551 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f9d07580-1e86-4d25-9f2a-5c93c636c1b7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:35.024060 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f9d07580-1e86-4d25-9f2a-5c93c636c1b7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:35.024850 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f9d07580-1e86-4d25-9f2a-5c93c636c1b7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:35.025465 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f9d07580-1e86-4d25-9f2a-5c93c636c1b7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:35.057970 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f9d07580-1e86-4d25-9f2a-5c93c636c1b7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:35.058757 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f9d07580-1e86-4d25-9f2a-5c93c636c1b7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:35.059403 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.objects.instance [None req-f9d07580-1e86-4d25-9f2a-5c93c636c1b7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lazy-loading 'fault' on Instance uuid 68a3fbd7-ef09-4f47-997e-918723eb5105 {{(pid=116674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:33:35.101986 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f9d07580-1e86-4d25-9f2a-5c93c636c1b7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:35.112573 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f9d07580-1e86-4d25-9f2a-5c93c636c1b7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1308 microversion: 2.1 time: 0.099837 Dec 20 09:33:35.113168 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 407/779] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:35 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:35.255867 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-6ef1a248-417d-4385-8c2b-f131025488c3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:35.256797 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-6ef1a248-417d-4385-8c2b-f131025488c3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:35.264118 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6ef1a248-417d-4385-8c2b-f131025488c3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:35.264739 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6ef1a248-417d-4385-8c2b-f131025488c3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:35.265621 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6ef1a248-417d-4385-8c2b-f131025488c3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:35.266180 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6ef1a248-417d-4385-8c2b-f131025488c3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:35.408274 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-6ef1a248-417d-4385-8c2b-f131025488c3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:35.414890 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-6ef1a248-417d-4385-8c2b-f131025488c3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:35.416403 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-6ef1a248-417d-4385-8c2b-f131025488c3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:35.417547 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-6ef1a248-417d-4385-8c2b-f131025488c3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1723 microversion: 2.20 time: 0.165377 Dec 20 09:33:35.418103 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 408/780] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:35 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:33:35.761406 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-025c2abe-d08e-4204-adc0-341044ea16dd tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Action: 'create', calling method: .version_select at 0x7f914e32a700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-14800941"}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:33:35.774806 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-025c2abe-d08e-4204-adc0-341044ea16dd tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Getting quotas for project 5e2d8e2c4a484ab78e35371e7ce0409e. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:33:35.778699 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-025c2abe-d08e-4204-adc0-341044ea16dd tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Getting quotas for user a71c528f1e5c49f69104826c0e4dafee and project 5e2d8e2c4a484ab78e35371e7ce0409e. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:33:35.840292 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.network.neutron [None req-72642588-27b4-49d8-8806-98a67f771e0f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] validate_networks() for [('85d805f9-8f65-44aa-8b19-1203a8239e20', None, None, None, None, None)] {{(pid=116675) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 09:33:35.967918 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-025c2abe-d08e-4204-adc0-341044ea16dd tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Getting quotas for project 5e2d8e2c4a484ab78e35371e7ce0409e. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:33:35.972313 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-025c2abe-d08e-4204-adc0-341044ea16dd tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Getting quotas for user a71c528f1e5c49f69104826c0e4dafee and project 5e2d8e2c4a484ab78e35371e7ce0409e. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:33:35.987231 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-025c2abe-d08e-4204-adc0-341044ea16dd tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.229280 Dec 20 09:33:35.987875 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 409/781] 10.222.0.62 () {60 vars in 1157 bytes} [Mon Dec 20 09:33:35 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:36.035437 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-bda9237a-b261-4a76-aae6-9f7deb475d84 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-343024807", "imageRef": "179c7924-ffe4-4bc7-bec8-c7c6d9feb278", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-14800941", "networks": [{"uuid": "9521245f-4926-4bcc-b62e-fb263d1cbb34"}]}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:33:36.089814 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.network.neutron [None req-bda9237a-b261-4a76-aae6-9f7deb475d84 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] validate_networks() for [('9521245f-4926-4bcc-b62e-fb263d1cbb34', None, None, None, None, None)] {{(pid=116674) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 09:33:36.369703 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-72642588-27b4-49d8-8806-98a67f771e0f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Flavor limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 09:33:36.370128 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-72642588-27b4-49d8-8806-98a67f771e0f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Image limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 09:33:36.370632 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-72642588-27b4-49d8-8806-98a67f771e0f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Flavor pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 09:33:36.371043 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-72642588-27b4-49d8-8806-98a67f771e0f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Image pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 09:33:36.371456 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-72642588-27b4-49d8-8806-98a67f771e0f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 09:33:36.380845 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-72642588-27b4-49d8-8806-98a67f771e0f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:36.381295 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-72642588-27b4-49d8-8806-98a67f771e0f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:36.382112 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-72642588-27b4-49d8-8806-98a67f771e0f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:36.382546 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-72642588-27b4-49d8-8806-98a67f771e0f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:36.400459 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-72642588-27b4-49d8-8806-98a67f771e0f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Getting quotas for project d5a528a79d2c4c94bd7b4a0b200b21f7. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:33:36.404523 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-72642588-27b4-49d8-8806-98a67f771e0f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Getting quotas for user 52d81af5e27f434dba28295236ca39d0 and project d5a528a79d2c4c94bd7b4a0b200b21f7. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:33:36.415650 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-72642588-27b4-49d8-8806-98a67f771e0f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Going to run 1 instances... {{(pid=116675) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 09:33:36.418047 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-72642588-27b4-49d8-8806-98a67f771e0f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f828f0b-c445-46a5-9960-492746785ef3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 09:33:36.540390 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-72642588-27b4-49d8-8806-98a67f771e0f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.643118 Dec 20 09:33:36.546024 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 373/782] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 20 09:33:33 2021] POST /compute/v2.1/servers => generated 402 bytes in 2644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 09:33:36.546024 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-5767d9e2-8176-405b-968f-099e4d3445f2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:36.546024 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-5767d9e2-8176-405b-968f-099e4d3445f2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:36.552860 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5767d9e2-8176-405b-968f-099e4d3445f2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:36.553314 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5767d9e2-8176-405b-968f-099e4d3445f2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:36.554090 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5767d9e2-8176-405b-968f-099e4d3445f2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:36.554527 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5767d9e2-8176-405b-968f-099e4d3445f2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:36.593580 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5767d9e2-8176-405b-968f-099e4d3445f2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:36.594027 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5767d9e2-8176-405b-968f-099e4d3445f2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:36.594471 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.objects.instance [None req-5767d9e2-8176-405b-968f-099e4d3445f2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lazy-loading 'fault' on Instance uuid 68a3fbd7-ef09-4f47-997e-918723eb5105 {{(pid=116675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:33:36.640912 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-5767d9e2-8176-405b-968f-099e4d3445f2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:36.642597 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-bda9237a-b261-4a76-aae6-9f7deb475d84 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Flavor limits 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 09:33:36.643193 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-bda9237a-b261-4a76-aae6-9f7deb475d84 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Image limits 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 09:33:36.643872 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-bda9237a-b261-4a76-aae6-9f7deb475d84 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Flavor pref 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 09:33:36.644270 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-bda9237a-b261-4a76-aae6-9f7deb475d84 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Image pref 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 09:33:36.644889 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-bda9237a-b261-4a76-aae6-9f7deb475d84 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 09:33:36.648632 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-5767d9e2-8176-405b-968f-099e4d3445f2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1308 microversion: 2.1 time: 0.106431 Dec 20 09:33:36.649597 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 374/783] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:36 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:36.654144 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-caaadaae-fa83-41d0-af98-113d3fcf9fea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:36.654912 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-caaadaae-fa83-41d0-af98-113d3fcf9fea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:36.656664 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bda9237a-b261-4a76-aae6-9f7deb475d84 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:36.657308 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bda9237a-b261-4a76-aae6-9f7deb475d84 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:36.658113 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bda9237a-b261-4a76-aae6-9f7deb475d84 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:36.658654 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bda9237a-b261-4a76-aae6-9f7deb475d84 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:36.664598 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-caaadaae-fa83-41d0-af98-113d3fcf9fea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:36.665211 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-caaadaae-fa83-41d0-af98-113d3fcf9fea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:36.666149 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-caaadaae-fa83-41d0-af98-113d3fcf9fea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:36.666732 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-caaadaae-fa83-41d0-af98-113d3fcf9fea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:36.675927 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-bda9237a-b261-4a76-aae6-9f7deb475d84 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Getting quotas for project 5e2d8e2c4a484ab78e35371e7ce0409e. Resources: {'ram', 'cores', 'instances'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:33:36.680430 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-bda9237a-b261-4a76-aae6-9f7deb475d84 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Getting quotas for user a71c528f1e5c49f69104826c0e4dafee and project 5e2d8e2c4a484ab78e35371e7ce0409e. Resources: {'ram', 'cores', 'instances'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:33:36.694539 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-bda9237a-b261-4a76-aae6-9f7deb475d84 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Going to run 1 instances... {{(pid=116674) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 09:33:36.696836 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-bda9237a-b261-4a76-aae6-9f7deb475d84 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='179c7924-ffe4-4bc7-bec8-c7c6d9feb278',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 09:33:36.811943 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-caaadaae-fa83-41d0-af98-113d3fcf9fea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:36.824621 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-caaadaae-fa83-41d0-af98-113d3fcf9fea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:36.826780 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-caaadaae-fa83-41d0-af98-113d3fcf9fea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:36.827992 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-caaadaae-fa83-41d0-af98-113d3fcf9fea tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1723 microversion: 2.20 time: 0.177459 Dec 20 09:33:36.828595 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 375/784] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:36 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:33:36.833181 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8cff3cba-e99e-4220-8685-50710230cd69 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:36.833851 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8cff3cba-e99e-4220-8685-50710230cd69 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:36.884947 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8cff3cba-e99e-4220-8685-50710230cd69 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:36.892029 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8cff3cba-e99e-4220-8685-50710230cd69 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1237 microversion: 2.1 time: 0.062260 Dec 20 09:33:36.892587 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 376/785] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:36 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1237 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:36.912552 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-bda9237a-b261-4a76-aae6-9f7deb475d84 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.881093 Dec 20 09:33:36.913243 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 410/786] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 20 09:33:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 20 09:33:36.922874 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-73ddecfb-e552-484d-9b63-eba3bdd8b786 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:36.923490 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-73ddecfb-e552-484d-9b63-eba3bdd8b786 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:36.980501 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-73ddecfb-e552-484d-9b63-eba3bdd8b786 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:36.991758 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-73ddecfb-e552-484d-9b63-eba3bdd8b786 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1256 microversion: 2.1 time: 0.068774 Dec 20 09:33:36.991758 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 377/787] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:36 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1256 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:37.665362 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-6c4f7678-0e99-47a4-a25c-f5ae0481abbf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:37.665977 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-6c4f7678-0e99-47a4-a25c-f5ae0481abbf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:37.672965 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6c4f7678-0e99-47a4-a25c-f5ae0481abbf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:37.673411 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6c4f7678-0e99-47a4-a25c-f5ae0481abbf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:37.674359 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6c4f7678-0e99-47a4-a25c-f5ae0481abbf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:37.674802 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6c4f7678-0e99-47a4-a25c-f5ae0481abbf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:37.705700 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6c4f7678-0e99-47a4-a25c-f5ae0481abbf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:37.706176 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6c4f7678-0e99-47a4-a25c-f5ae0481abbf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:37.706776 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.objects.instance [None req-6c4f7678-0e99-47a4-a25c-f5ae0481abbf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lazy-loading 'fault' on Instance uuid 68a3fbd7-ef09-4f47-997e-918723eb5105 {{(pid=116674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:33:37.746086 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-6c4f7678-0e99-47a4-a25c-f5ae0481abbf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:37.755674 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-6c4f7678-0e99-47a4-a25c-f5ae0481abbf tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1308 microversion: 2.1 time: 0.094021 Dec 20 09:33:37.756632 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 411/788] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:37 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:37.847860 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8a995f40-4900-4492-8b41-ff4a3d88d2cd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:37.848551 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8a995f40-4900-4492-8b41-ff4a3d88d2cd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:37.854413 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8a995f40-4900-4492-8b41-ff4a3d88d2cd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:37.854870 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8a995f40-4900-4492-8b41-ff4a3d88d2cd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:37.855651 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8a995f40-4900-4492-8b41-ff4a3d88d2cd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:37.856106 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8a995f40-4900-4492-8b41-ff4a3d88d2cd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:37.908913 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f02e96c7-74a3-4c88-ab1b-ad1f273f6f66 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:37.909581 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f02e96c7-74a3-4c88-ab1b-ad1f273f6f66 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:37.920548 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f02e96c7-74a3-4c88-ab1b-ad1f273f6f66 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:37.920548 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f02e96c7-74a3-4c88-ab1b-ad1f273f6f66 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:37.920548 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f02e96c7-74a3-4c88-ab1b-ad1f273f6f66 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:37.920548 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f02e96c7-74a3-4c88-ab1b-ad1f273f6f66 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:37.989228 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f02e96c7-74a3-4c88-ab1b-ad1f273f6f66 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:37.996610 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f02e96c7-74a3-4c88-ab1b-ad1f273f6f66 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1241 microversion: 2.1 time: 0.091300 Dec 20 09:33:37.997173 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 412/789] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:37 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:38.009946 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-99f4effc-ebf0-4b72-994e-5786224ead5f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:38.010630 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-99f4effc-ebf0-4b72-994e-5786224ead5f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:38.010768 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8a995f40-4900-4492-8b41-ff4a3d88d2cd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:38.022260 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8a995f40-4900-4492-8b41-ff4a3d88d2cd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:38.023749 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8a995f40-4900-4492-8b41-ff4a3d88d2cd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:38.025110 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8a995f40-4900-4492-8b41-ff4a3d88d2cd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1723 microversion: 2.20 time: 0.180973 Dec 20 09:33:38.025833 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 378/790] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:37 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:33:38.064910 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-99f4effc-ebf0-4b72-994e-5786224ead5f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:38.074790 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-99f4effc-ebf0-4b72-994e-5786224ead5f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1256 microversion: 2.1 time: 0.068349 Dec 20 09:33:38.075502 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 413/791] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:38 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1256 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:38.772735 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-93d9caee-b8f8-42bc-834a-41bd584f29a2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:38.773529 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-93d9caee-b8f8-42bc-834a-41bd584f29a2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:38.780433 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-93d9caee-b8f8-42bc-834a-41bd584f29a2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:38.780895 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-93d9caee-b8f8-42bc-834a-41bd584f29a2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:38.781652 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-93d9caee-b8f8-42bc-834a-41bd584f29a2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:38.782082 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-93d9caee-b8f8-42bc-834a-41bd584f29a2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:38.811929 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-93d9caee-b8f8-42bc-834a-41bd584f29a2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:38.812375 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-93d9caee-b8f8-42bc-834a-41bd584f29a2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:38.812819 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.objects.instance [None req-93d9caee-b8f8-42bc-834a-41bd584f29a2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lazy-loading 'fault' on Instance uuid 68a3fbd7-ef09-4f47-997e-918723eb5105 {{(pid=116675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:33:38.851837 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-93d9caee-b8f8-42bc-834a-41bd584f29a2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:38.859778 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-93d9caee-b8f8-42bc-834a-41bd584f29a2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 200 len: 1308 microversion: 2.1 time: 0.090702 Dec 20 09:33:38.860349 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 379/792] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:38 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:39.015090 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-493165d4-b299-4a51-bd88-deb925c83187 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:39.015634 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-493165d4-b299-4a51-bd88-deb925c83187 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:39.021489 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-493165d4-b299-4a51-bd88-deb925c83187 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:39.021939 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-493165d4-b299-4a51-bd88-deb925c83187 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:39.022721 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-493165d4-b299-4a51-bd88-deb925c83187 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:39.023161 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-493165d4-b299-4a51-bd88-deb925c83187 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:39.045382 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-72fa19c4-d065-4a0c-9f1f-a3f93360dcf6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:39.046094 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-72fa19c4-d065-4a0c-9f1f-a3f93360dcf6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:39.053016 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-72fa19c4-d065-4a0c-9f1f-a3f93360dcf6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:39.053545 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-72fa19c4-d065-4a0c-9f1f-a3f93360dcf6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:39.054401 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-72fa19c4-d065-4a0c-9f1f-a3f93360dcf6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:39.054909 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-72fa19c4-d065-4a0c-9f1f-a3f93360dcf6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:39.086015 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-493165d4-b299-4a51-bd88-deb925c83187 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:39.095484 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-493165d4-b299-4a51-bd88-deb925c83187 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1233 microversion: 2.1 time: 0.084197 Dec 20 09:33:39.096105 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 414/793] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:39 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1233 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:39.104492 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f268c74e-154b-4500-a243-65f77be602dc tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:39.104492 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f268c74e-154b-4500-a243-65f77be602dc tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:39.111637 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f268c74e-154b-4500-a243-65f77be602dc tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:39.112202 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f268c74e-154b-4500-a243-65f77be602dc tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:39.113061 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f268c74e-154b-4500-a243-65f77be602dc tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:39.113475 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f268c74e-154b-4500-a243-65f77be602dc tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:39.183720 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f268c74e-154b-4500-a243-65f77be602dc tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:39.191615 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f268c74e-154b-4500-a243-65f77be602dc tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1252 microversion: 2.1 time: 0.094276 Dec 20 09:33:39.192304 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 415/794] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:39 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1252 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:39.218224 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-72fa19c4-d065-4a0c-9f1f-a3f93360dcf6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:39.226055 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-72fa19c4-d065-4a0c-9f1f-a3f93360dcf6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:39.227591 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-72fa19c4-d065-4a0c-9f1f-a3f93360dcf6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:39.228774 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-72fa19c4-d065-4a0c-9f1f-a3f93360dcf6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1723 microversion: 2.20 time: 0.188772 Dec 20 09:33:39.229333 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 380/795] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:39 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:33:39.875964 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-62d434a6-dd9d-48b1-9c0d-395686efcf49 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:39.876500 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-62d434a6-dd9d-48b1-9c0d-395686efcf49 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 68a3fbd7-ef09-4f47-997e-918723eb5105] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:39.882250 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-62d434a6-dd9d-48b1-9c0d-395686efcf49 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:39.882699 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-62d434a6-dd9d-48b1-9c0d-395686efcf49 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:39.883473 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-62d434a6-dd9d-48b1-9c0d-395686efcf49 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:39.883934 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-62d434a6-dd9d-48b1-9c0d-395686efcf49 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:39.897288 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.wsgi [None req-62d434a6-dd9d-48b1-9c0d-395686efcf49 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] HTTP exception thrown: Instance 68a3fbd7-ef09-4f47-997e-918723eb5105 could not be found. Dec 20 09:33:39.897884 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-62d434a6-dd9d-48b1-9c0d-395686efcf49 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Returning 404 to user: Instance 68a3fbd7-ef09-4f47-997e-918723eb5105 could not be found. {{(pid=116674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:33:39.898684 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-62d434a6-dd9d-48b1-9c0d-395686efcf49 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105" status: 404 len: 111 microversion: 2.1 time: 0.026752 Dec 20 09:33:39.899197 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 416/796] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:39 2021] GET /compute/v2.1/servers/68a3fbd7-ef09-4f47-997e-918723eb5105 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:33:39.907397 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6b0b65e4-46e9-4387-90fc-61b28b2c30f0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:39.907944 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6b0b65e4-46e9-4387-90fc-61b28b2c30f0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:39.914250 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6b0b65e4-46e9-4387-90fc-61b28b2c30f0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:39.914700 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6b0b65e4-46e9-4387-90fc-61b28b2c30f0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:39.915477 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6b0b65e4-46e9-4387-90fc-61b28b2c30f0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:39.915956 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6b0b65e4-46e9-4387-90fc-61b28b2c30f0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:39.941113 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6b0b65e4-46e9-4387-90fc-61b28b2c30f0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Going to try to terminate instance {{(pid=116675) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 09:33:40.112716 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d57f63f4-c137-4ece-948b-abecf44a38af tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:40.113332 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d57f63f4-c137-4ece-948b-abecf44a38af tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:40.119715 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d57f63f4-c137-4ece-948b-abecf44a38af tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:40.120186 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d57f63f4-c137-4ece-948b-abecf44a38af tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:40.120957 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d57f63f4-c137-4ece-948b-abecf44a38af tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:40.121396 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d57f63f4-c137-4ece-948b-abecf44a38af tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:40.183265 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d57f63f4-c137-4ece-948b-abecf44a38af tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:40.190985 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d57f63f4-c137-4ece-948b-abecf44a38af tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1289 microversion: 2.1 time: 0.082057 Dec 20 09:33:40.191558 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 417/797] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:40 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1289 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:40.195869 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6b0b65e4-46e9-4387-90fc-61b28b2c30f0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 204 len: 0 microversion: 2.1 time: 0.292310 Dec 20 09:33:40.196445 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 381/798] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 20 09:33:39 2021] DELETE /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 20 09:33:40.204266 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4c474259-e1c0-4898-b268-21a25b824ae7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:40.204936 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-4c474259-e1c0-4898-b268-21a25b824ae7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:40.207753 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b3c53049-dbd4-4a4e-b708-bf9b7918369a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:40.208449 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b3c53049-dbd4-4a4e-b708-bf9b7918369a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:40.210802 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4c474259-e1c0-4898-b268-21a25b824ae7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:40.211248 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4c474259-e1c0-4898-b268-21a25b824ae7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:40.212059 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4c474259-e1c0-4898-b268-21a25b824ae7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:40.212497 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4c474259-e1c0-4898-b268-21a25b824ae7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:40.214956 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b3c53049-dbd4-4a4e-b708-bf9b7918369a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:40.215516 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b3c53049-dbd4-4a4e-b708-bf9b7918369a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:40.219126 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b3c53049-dbd4-4a4e-b708-bf9b7918369a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:40.219651 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b3c53049-dbd4-4a4e-b708-bf9b7918369a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:40.299253 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b3c53049-dbd4-4a4e-b708-bf9b7918369a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:40.306672 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b3c53049-dbd4-4a4e-b708-bf9b7918369a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1252 microversion: 2.1 time: 0.102758 Dec 20 09:33:40.307332 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 382/799] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:40 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1252 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:40.312266 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ab2c2e45-93db-40bd-8f77-b1606fd69736 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:40.313060 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ab2c2e45-93db-40bd-8f77-b1606fd69736 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:40.322392 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ab2c2e45-93db-40bd-8f77-b1606fd69736 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:40.322837 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ab2c2e45-93db-40bd-8f77-b1606fd69736 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:40.323851 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ab2c2e45-93db-40bd-8f77-b1606fd69736 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:40.324381 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ab2c2e45-93db-40bd-8f77-b1606fd69736 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:40.383258 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-4c474259-e1c0-4898-b268-21a25b824ae7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:40.391445 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-4c474259-e1c0-4898-b268-21a25b824ae7 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.191040 Dec 20 09:33:40.392269 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 418/800] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:40 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:40.477436 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ab2c2e45-93db-40bd-8f77-b1606fd69736 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:40.485780 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ab2c2e45-93db-40bd-8f77-b1606fd69736 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:40.487236 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ab2c2e45-93db-40bd-8f77-b1606fd69736 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:40.488424 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ab2c2e45-93db-40bd-8f77-b1606fd69736 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1723 microversion: 2.20 time: 0.180070 Dec 20 09:33:40.489174 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 383/801] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:40 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:33:41.212034 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e257b3b4-7f28-4e54-a9d1-7ca09a1df924 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:41.213471 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e257b3b4-7f28-4e54-a9d1-7ca09a1df924 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:41.223612 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e257b3b4-7f28-4e54-a9d1-7ca09a1df924 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:41.224401 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e257b3b4-7f28-4e54-a9d1-7ca09a1df924 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:41.225456 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e257b3b4-7f28-4e54-a9d1-7ca09a1df924 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:41.226086 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e257b3b4-7f28-4e54-a9d1-7ca09a1df924 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:41.302001 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e257b3b4-7f28-4e54-a9d1-7ca09a1df924 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:41.314305 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e257b3b4-7f28-4e54-a9d1-7ca09a1df924 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1295 microversion: 2.1 time: 0.110332 Dec 20 09:33:41.315714 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 419/802] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:41 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1295 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:41.335067 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-aa0052e4-651f-4bc9-988a-a1368a12f02a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:41.336871 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-aa0052e4-651f-4bc9-988a-a1368a12f02a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:41.352778 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-aa0052e4-651f-4bc9-988a-a1368a12f02a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:41.354010 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-aa0052e4-651f-4bc9-988a-a1368a12f02a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:41.355609 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-aa0052e4-651f-4bc9-988a-a1368a12f02a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:41.357030 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-aa0052e4-651f-4bc9-988a-a1368a12f02a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:41.409896 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e1c2389a-5539-4190-9190-63111506876d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:41.412308 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e1c2389a-5539-4190-9190-63111506876d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:41.419831 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e1c2389a-5539-4190-9190-63111506876d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:41.420287 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e1c2389a-5539-4190-9190-63111506876d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:41.421668 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e1c2389a-5539-4190-9190-63111506876d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:41.422304 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e1c2389a-5539-4190-9190-63111506876d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:41.431030 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-aa0052e4-651f-4bc9-988a-a1368a12f02a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:41.440231 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-aa0052e4-651f-4bc9-988a-a1368a12f02a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1314 microversion: 2.1 time: 0.119102 Dec 20 09:33:41.450499 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 384/803] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:41 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1314 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:41.507158 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-da0a83ad-e07c-4128-8002-7b8aa2295cf6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:41.508334 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-da0a83ad-e07c-4128-8002-7b8aa2295cf6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:41.521501 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-da0a83ad-e07c-4128-8002-7b8aa2295cf6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:41.524031 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-da0a83ad-e07c-4128-8002-7b8aa2295cf6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:41.528011 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-da0a83ad-e07c-4128-8002-7b8aa2295cf6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:41.528781 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-da0a83ad-e07c-4128-8002-7b8aa2295cf6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:41.672319 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e1c2389a-5539-4190-9190-63111506876d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:41.680802 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e1c2389a-5539-4190-9190-63111506876d tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.275393 Dec 20 09:33:41.681716 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 420/804] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:41 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:41.742587 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-da0a83ad-e07c-4128-8002-7b8aa2295cf6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:41.756750 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-da0a83ad-e07c-4128-8002-7b8aa2295cf6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:41.758330 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-da0a83ad-e07c-4128-8002-7b8aa2295cf6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:41.764378 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-da0a83ad-e07c-4128-8002-7b8aa2295cf6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.256234 Dec 20 09:33:41.765264 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 385/805] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:41 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:33:42.337857 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3e54874d-21d4-402c-8621-9ff93a78bd70 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:42.339045 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-3e54874d-21d4-402c-8621-9ff93a78bd70 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:42.347472 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3e54874d-21d4-402c-8621-9ff93a78bd70 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:42.348362 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3e54874d-21d4-402c-8621-9ff93a78bd70 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:42.349601 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3e54874d-21d4-402c-8621-9ff93a78bd70 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:42.350291 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3e54874d-21d4-402c-8621-9ff93a78bd70 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:42.457392 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-76994231-cdb9-432e-a830-60914ea1103e tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:42.458746 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-76994231-cdb9-432e-a830-60914ea1103e tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:42.467501 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-76994231-cdb9-432e-a830-60914ea1103e tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:42.468861 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-76994231-cdb9-432e-a830-60914ea1103e tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:42.470064 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-76994231-cdb9-432e-a830-60914ea1103e tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:42.470694 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-76994231-cdb9-432e-a830-60914ea1103e tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:42.517880 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3e54874d-21d4-402c-8621-9ff93a78bd70 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:42.526486 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3e54874d-21d4-402c-8621-9ff93a78bd70 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.193021 Dec 20 09:33:42.540909 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 421/806] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:42 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:42.668836 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-76994231-cdb9-432e-a830-60914ea1103e tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:42.677296 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-76994231-cdb9-432e-a830-60914ea1103e tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.224268 Dec 20 09:33:42.677814 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 386/807] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:42 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:42.700145 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-97d3cd9c-7e6b-4f62-8123-b631be1e5410 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:42.701976 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-97d3cd9c-7e6b-4f62-8123-b631be1e5410 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:42.708337 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-97d3cd9c-7e6b-4f62-8123-b631be1e5410 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:42.717594 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-97d3cd9c-7e6b-4f62-8123-b631be1e5410 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:42.717594 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-97d3cd9c-7e6b-4f62-8123-b631be1e5410 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:42.717594 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-97d3cd9c-7e6b-4f62-8123-b631be1e5410 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:42.789630 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1bedbf9d-7694-4535-939f-36aee942f848 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:42.790235 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1bedbf9d-7694-4535-939f-36aee942f848 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:42.797083 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1bedbf9d-7694-4535-939f-36aee942f848 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:42.798657 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1bedbf9d-7694-4535-939f-36aee942f848 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:42.798657 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1bedbf9d-7694-4535-939f-36aee942f848 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:42.799122 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1bedbf9d-7694-4535-939f-36aee942f848 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:42.882309 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-97d3cd9c-7e6b-4f62-8123-b631be1e5410 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:42.898546 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-97d3cd9c-7e6b-4f62-8123-b631be1e5410 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.203937 Dec 20 09:33:42.899601 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 422/808] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:42 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:42.973176 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1bedbf9d-7694-4535-939f-36aee942f848 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:42.978507 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-5b290cb0-bec5-4f57-acca-7e43d5f6c091 req-d09524d4-0fb7-4404-a805-3dc208f9102f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1243c272-99f3-4606-9eb2-a4fe7cd30de7", "tag": "1b76648a-4a62-41c9-a26e-314b3c466e02"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:33:42.980700 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:33:42.980700 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:33:42.984061 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1bedbf9d-7694-4535-939f-36aee942f848 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:42.985546 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1bedbf9d-7694-4535-939f-36aee942f848 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:42.986709 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1bedbf9d-7694-4535-939f-36aee942f848 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.200908 Dec 20 09:33:42.987566 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 387/809] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:42 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:33:42.998238 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-5b290cb0-bec5-4f57-acca-7e43d5f6c091 req-d09524d4-0fb7-4404-a805-3dc208f9102f service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:42.998690 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-5b290cb0-bec5-4f57-acca-7e43d5f6c091 req-d09524d4-0fb7-4404-a805-3dc208f9102f service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:43.011280 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-5b290cb0-bec5-4f57-acca-7e43d5f6c091 req-d09524d4-0fb7-4404-a805-3dc208f9102f service nova] Creating event network-changed:1b76648a-4a62-41c9-a26e-314b3c466e02 for instance 1243c272-99f3-4606-9eb2-a4fe7cd30de7 on hv-cinder-81908 Dec 20 09:33:43.018852 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-5b290cb0-bec5-4f57-acca-7e43d5f6c091 req-d09524d4-0fb7-4404-a805-3dc208f9102f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115999 Dec 20 09:33:43.019452 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 423/810] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:33:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:33:43.557674 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2a5b50fa-2881-4b56-98bc-a7f738f7b3db tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:43.558281 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2a5b50fa-2881-4b56-98bc-a7f738f7b3db tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:43.565079 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2a5b50fa-2881-4b56-98bc-a7f738f7b3db tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:43.565531 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2a5b50fa-2881-4b56-98bc-a7f738f7b3db tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:43.566304 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2a5b50fa-2881-4b56-98bc-a7f738f7b3db tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:43.566739 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2a5b50fa-2881-4b56-98bc-a7f738f7b3db tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:43.694926 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1232415c-cf7d-498e-b70f-45a57edd2822 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:43.695450 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-2a5b50fa-2881-4b56-98bc-a7f738f7b3db tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:43.695805 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-1232415c-cf7d-498e-b70f-45a57edd2822 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:43.702003 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1232415c-cf7d-498e-b70f-45a57edd2822 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:43.702442 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1232415c-cf7d-498e-b70f-45a57edd2822 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:43.702739 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2a5b50fa-2881-4b56-98bc-a7f738f7b3db tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.148760 Dec 20 09:33:43.703212 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1232415c-cf7d-498e-b70f-45a57edd2822 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:43.703307 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 388/811] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:43 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:43.703753 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1232415c-cf7d-498e-b70f-45a57edd2822 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:43.833278 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1232415c-cf7d-498e-b70f-45a57edd2822 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:43.840367 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1232415c-cf7d-498e-b70f-45a57edd2822 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.150072 Dec 20 09:33:43.840918 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 424/812] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:43 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:43.915727 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b7a5bbc7-2b0a-444a-8647-ae2395377c3a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:43.916336 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b7a5bbc7-2b0a-444a-8647-ae2395377c3a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:43.922177 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b7a5bbc7-2b0a-444a-8647-ae2395377c3a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:43.922624 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b7a5bbc7-2b0a-444a-8647-ae2395377c3a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:43.923393 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b7a5bbc7-2b0a-444a-8647-ae2395377c3a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:43.923852 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b7a5bbc7-2b0a-444a-8647-ae2395377c3a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:44.004157 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-dd5f2f07-2cea-4b3a-af8a-3529c409749d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:44.004766 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-dd5f2f07-2cea-4b3a-af8a-3529c409749d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:44.011214 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dd5f2f07-2cea-4b3a-af8a-3529c409749d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:44.011783 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dd5f2f07-2cea-4b3a-af8a-3529c409749d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:44.012649 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dd5f2f07-2cea-4b3a-af8a-3529c409749d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:44.013155 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dd5f2f07-2cea-4b3a-af8a-3529c409749d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:44.068243 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b7a5bbc7-2b0a-444a-8647-ae2395377c3a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:44.075468 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b7a5bbc7-2b0a-444a-8647-ae2395377c3a tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.163318 Dec 20 09:33:44.076654 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 389/813] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:43 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:44.150474 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-dd5f2f07-2cea-4b3a-af8a-3529c409749d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:44.158193 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-dd5f2f07-2cea-4b3a-af8a-3529c409749d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:44.159740 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-dd5f2f07-2cea-4b3a-af8a-3529c409749d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:44.160901 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-dd5f2f07-2cea-4b3a-af8a-3529c409749d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.160300 Dec 20 09:33:44.161464 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 425/814] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:43 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:33:44.719402 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-3607f1bc-38e6-4caf-8cc7-0b61d398dae0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:44.720022 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-3607f1bc-38e6-4caf-8cc7-0b61d398dae0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:44.726234 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3607f1bc-38e6-4caf-8cc7-0b61d398dae0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:44.726675 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3607f1bc-38e6-4caf-8cc7-0b61d398dae0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:44.727446 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3607f1bc-38e6-4caf-8cc7-0b61d398dae0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:44.727905 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3607f1bc-38e6-4caf-8cc7-0b61d398dae0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:44.856638 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-177e926d-11f2-48bc-92c1-8c0dd0c16b66 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:44.857270 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-177e926d-11f2-48bc-92c1-8c0dd0c16b66 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:44.857730 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-3607f1bc-38e6-4caf-8cc7-0b61d398dae0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:44.863636 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-177e926d-11f2-48bc-92c1-8c0dd0c16b66 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:44.864113 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-177e926d-11f2-48bc-92c1-8c0dd0c16b66 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:44.864824 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-3607f1bc-38e6-4caf-8cc7-0b61d398dae0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.149553 Dec 20 09:33:44.864944 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-177e926d-11f2-48bc-92c1-8c0dd0c16b66 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:44.865305 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-177e926d-11f2-48bc-92c1-8c0dd0c16b66 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:44.865413 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 390/815] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:44 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:44.991543 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-177e926d-11f2-48bc-92c1-8c0dd0c16b66 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:44.999133 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-177e926d-11f2-48bc-92c1-8c0dd0c16b66 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.146183 Dec 20 09:33:44.999722 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 426/816] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:44 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:45.092707 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-420d3b89-e428-4e8e-bdad-9b189261bf98 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:45.093344 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-420d3b89-e428-4e8e-bdad-9b189261bf98 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:45.099089 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-420d3b89-e428-4e8e-bdad-9b189261bf98 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:45.099534 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-420d3b89-e428-4e8e-bdad-9b189261bf98 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:45.100346 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-420d3b89-e428-4e8e-bdad-9b189261bf98 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:45.100779 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-420d3b89-e428-4e8e-bdad-9b189261bf98 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:45.178042 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-bcf45144-0d3e-4c06-bbb8-8dd6a766998b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:45.178648 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-bcf45144-0d3e-4c06-bbb8-8dd6a766998b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:45.184571 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bcf45144-0d3e-4c06-bbb8-8dd6a766998b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:45.185021 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bcf45144-0d3e-4c06-bbb8-8dd6a766998b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:45.185820 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bcf45144-0d3e-4c06-bbb8-8dd6a766998b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:45.186254 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bcf45144-0d3e-4c06-bbb8-8dd6a766998b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:45.236741 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-420d3b89-e428-4e8e-bdad-9b189261bf98 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:45.243990 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-420d3b89-e428-4e8e-bdad-9b189261bf98 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.155439 Dec 20 09:33:45.244561 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 391/817] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:45 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:45.318968 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-bcf45144-0d3e-4c06-bbb8-8dd6a766998b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:45.327263 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-bcf45144-0d3e-4c06-bbb8-8dd6a766998b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:45.328790 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-bcf45144-0d3e-4c06-bbb8-8dd6a766998b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:45.329937 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-bcf45144-0d3e-4c06-bbb8-8dd6a766998b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.155576 Dec 20 09:33:45.330504 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 427/818] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:45 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:33:45.881026 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-117e77dd-dfad-4a64-9848-a521d1177168 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:45.881626 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-117e77dd-dfad-4a64-9848-a521d1177168 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:45.887806 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-117e77dd-dfad-4a64-9848-a521d1177168 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:45.888248 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-117e77dd-dfad-4a64-9848-a521d1177168 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:45.889008 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-117e77dd-dfad-4a64-9848-a521d1177168 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:45.889434 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-117e77dd-dfad-4a64-9848-a521d1177168 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:46.014922 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-117e77dd-dfad-4a64-9848-a521d1177168 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:46.015413 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-64e83d41-7bda-49ce-8566-33dfd4ddb4ec tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:46.016482 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-64e83d41-7bda-49ce-8566-33dfd4ddb4ec tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:46.022200 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-117e77dd-dfad-4a64-9848-a521d1177168 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.144714 Dec 20 09:33:46.022769 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 392/819] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:45 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:46.022906 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-64e83d41-7bda-49ce-8566-33dfd4ddb4ec tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:46.023290 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-64e83d41-7bda-49ce-8566-33dfd4ddb4ec tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:46.024087 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-64e83d41-7bda-49ce-8566-33dfd4ddb4ec tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:46.024512 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-64e83d41-7bda-49ce-8566-33dfd4ddb4ec tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:46.153523 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-64e83d41-7bda-49ce-8566-33dfd4ddb4ec tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:46.161206 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-64e83d41-7bda-49ce-8566-33dfd4ddb4ec tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.149383 Dec 20 09:33:46.161765 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 428/820] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:46 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:46.260711 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-3b51e75b-6630-41b3-870b-fc23dccf4f8f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:46.261274 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-3b51e75b-6630-41b3-870b-fc23dccf4f8f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:46.267043 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3b51e75b-6630-41b3-870b-fc23dccf4f8f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:46.267487 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3b51e75b-6630-41b3-870b-fc23dccf4f8f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:46.268288 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3b51e75b-6630-41b3-870b-fc23dccf4f8f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:46.268721 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3b51e75b-6630-41b3-870b-fc23dccf4f8f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:46.347971 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a5760837-8afa-4731-b3ca-582d6368d24d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:46.348569 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a5760837-8afa-4731-b3ca-582d6368d24d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:46.354313 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a5760837-8afa-4731-b3ca-582d6368d24d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:46.354751 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a5760837-8afa-4731-b3ca-582d6368d24d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:46.355523 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a5760837-8afa-4731-b3ca-582d6368d24d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:46.355981 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a5760837-8afa-4731-b3ca-582d6368d24d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:46.402763 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-3b51e75b-6630-41b3-870b-fc23dccf4f8f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:46.412948 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-3b51e75b-6630-41b3-870b-fc23dccf4f8f tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.155831 Dec 20 09:33:46.413567 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 393/821] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:46 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:46.495734 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a5760837-8afa-4731-b3ca-582d6368d24d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:46.503720 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a5760837-8afa-4731-b3ca-582d6368d24d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:46.505208 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a5760837-8afa-4731-b3ca-582d6368d24d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:46.506356 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a5760837-8afa-4731-b3ca-582d6368d24d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.162039 Dec 20 09:33:46.506917 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 429/822] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:46 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:33:47.039156 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-11cb4539-e51f-4c44-8b08-4c8fa1f3b44d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:47.039700 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-11cb4539-e51f-4c44-8b08-4c8fa1f3b44d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:47.046014 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-11cb4539-e51f-4c44-8b08-4c8fa1f3b44d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:47.046458 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-11cb4539-e51f-4c44-8b08-4c8fa1f3b44d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:47.047228 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-11cb4539-e51f-4c44-8b08-4c8fa1f3b44d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:47.047685 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-11cb4539-e51f-4c44-8b08-4c8fa1f3b44d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:47.173587 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-11cb4539-e51f-4c44-8b08-4c8fa1f3b44d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:47.177972 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3b8c1151-4288-4bd9-b3db-d6c675505742 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:47.178615 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-3b8c1151-4288-4bd9-b3db-d6c675505742 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:47.180842 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-11cb4539-e51f-4c44-8b08-4c8fa1f3b44d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.145395 Dec 20 09:33:47.181406 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 394/823] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:47 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:47.185170 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3b8c1151-4288-4bd9-b3db-d6c675505742 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:47.185622 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3b8c1151-4288-4bd9-b3db-d6c675505742 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:47.186436 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3b8c1151-4288-4bd9-b3db-d6c675505742 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:47.186872 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3b8c1151-4288-4bd9-b3db-d6c675505742 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:47.315012 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3b8c1151-4288-4bd9-b3db-d6c675505742 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:47.322144 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3b8c1151-4288-4bd9-b3db-d6c675505742 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.147791 Dec 20 09:33:47.322714 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 430/824] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:47 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:47.429820 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9796a155-65a5-4c43-a784-0283a737018c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:47.430592 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9796a155-65a5-4c43-a784-0283a737018c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:47.439807 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9796a155-65a5-4c43-a784-0283a737018c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:47.440248 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9796a155-65a5-4c43-a784-0283a737018c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:47.441019 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9796a155-65a5-4c43-a784-0283a737018c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:47.441444 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9796a155-65a5-4c43-a784-0283a737018c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:47.524199 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-268c6f48-b220-4933-9fe2-90d97b4e92ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:47.524812 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-268c6f48-b220-4933-9fe2-90d97b4e92ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:47.530807 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-268c6f48-b220-4933-9fe2-90d97b4e92ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:47.531258 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-268c6f48-b220-4933-9fe2-90d97b4e92ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:47.532176 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-268c6f48-b220-4933-9fe2-90d97b4e92ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:47.532608 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-268c6f48-b220-4933-9fe2-90d97b4e92ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:47.569343 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-9796a155-65a5-4c43-a784-0283a737018c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:47.577344 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9796a155-65a5-4c43-a784-0283a737018c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.151385 Dec 20 09:33:47.578013 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 395/825] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:47 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:47.662010 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-268c6f48-b220-4933-9fe2-90d97b4e92ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:47.676108 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-268c6f48-b220-4933-9fe2-90d97b4e92ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:47.678383 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-268c6f48-b220-4933-9fe2-90d97b4e92ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:47.679585 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-268c6f48-b220-4933-9fe2-90d97b4e92ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.159174 Dec 20 09:33:47.680166 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 431/826] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:47 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:33:48.197033 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-30b71ab8-50d5-461a-bfa3-f01379a15ebc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:48.197644 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-30b71ab8-50d5-461a-bfa3-f01379a15ebc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:48.204060 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-30b71ab8-50d5-461a-bfa3-f01379a15ebc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:48.204514 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-30b71ab8-50d5-461a-bfa3-f01379a15ebc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:48.205297 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-30b71ab8-50d5-461a-bfa3-f01379a15ebc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:48.205734 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-30b71ab8-50d5-461a-bfa3-f01379a15ebc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:48.334119 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-30b71ab8-50d5-461a-bfa3-f01379a15ebc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:48.339103 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-cc44e7a8-957b-42cf-8b24-15928002cb7b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:48.339791 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-cc44e7a8-957b-42cf-8b24-15928002cb7b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:48.342012 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-30b71ab8-50d5-461a-bfa3-f01379a15ebc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.148115 Dec 20 09:33:48.342584 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 396/827] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:48 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:48.346770 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cc44e7a8-957b-42cf-8b24-15928002cb7b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:48.347216 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cc44e7a8-957b-42cf-8b24-15928002cb7b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:48.348024 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cc44e7a8-957b-42cf-8b24-15928002cb7b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:48.348461 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cc44e7a8-957b-42cf-8b24-15928002cb7b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:48.473767 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-cc44e7a8-957b-42cf-8b24-15928002cb7b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:48.480994 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-cc44e7a8-957b-42cf-8b24-15928002cb7b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.145539 Dec 20 09:33:48.481598 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 432/828] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:48 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:48.594325 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1559020a-6204-4536-bb3f-1503deeb37f6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:48.594934 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1559020a-6204-4536-bb3f-1503deeb37f6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:48.600802 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1559020a-6204-4536-bb3f-1503deeb37f6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:48.601255 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1559020a-6204-4536-bb3f-1503deeb37f6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:48.602031 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1559020a-6204-4536-bb3f-1503deeb37f6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:48.602467 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1559020a-6204-4536-bb3f-1503deeb37f6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:48.698130 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-64e0711c-3091-4fa1-8ae8-b3fb4ac42eb9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:48.698732 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-64e0711c-3091-4fa1-8ae8-b3fb4ac42eb9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:48.704616 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-64e0711c-3091-4fa1-8ae8-b3fb4ac42eb9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:48.705055 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-64e0711c-3091-4fa1-8ae8-b3fb4ac42eb9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:48.705825 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-64e0711c-3091-4fa1-8ae8-b3fb4ac42eb9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:48.706249 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-64e0711c-3091-4fa1-8ae8-b3fb4ac42eb9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:48.732684 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1559020a-6204-4536-bb3f-1503deeb37f6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:48.740136 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1559020a-6204-4536-bb3f-1503deeb37f6 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.149993 Dec 20 09:33:48.740903 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 397/829] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:48 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:48.831329 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-64e0711c-3091-4fa1-8ae8-b3fb4ac42eb9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:48.839051 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-64e0711c-3091-4fa1-8ae8-b3fb4ac42eb9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:48.841036 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-64e0711c-3091-4fa1-8ae8-b3fb4ac42eb9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:48.841776 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-64e0711c-3091-4fa1-8ae8-b3fb4ac42eb9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.147440 Dec 20 09:33:48.842338 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 433/830] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:48 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:33:49.115343 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-b5b92219-78d4-47a1-a8f7-ff95b67388c5 req-b5210e20-e6db-4f05-a8b1-8becb21827dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9ba0eda-fab4-44dc-b41f-0c51574dca1f", "name": "network-vif-plugged", "status": "completed", "tag": "b868aa5a-bfbe-4a31-ac51-6ef583b78b0e"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:33:49.116976 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:33:49.116976 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:33:49.124056 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-b5b92219-78d4-47a1-a8f7-ff95b67388c5 req-b5210e20-e6db-4f05-a8b1-8becb21827dc service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:49.124452 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-b5b92219-78d4-47a1-a8f7-ff95b67388c5 req-b5210e20-e6db-4f05-a8b1-8becb21827dc service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:49.135015 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-b5b92219-78d4-47a1-a8f7-ff95b67388c5 req-b5210e20-e6db-4f05-a8b1-8becb21827dc service nova] Creating event network-vif-plugged:b868aa5a-bfbe-4a31-ac51-6ef583b78b0e for instance c9ba0eda-fab4-44dc-b41f-0c51574dca1f on hv-cinder-81908 Dec 20 09:33:49.139841 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-b5b92219-78d4-47a1-a8f7-ff95b67388c5 req-b5210e20-e6db-4f05-a8b1-8becb21827dc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028080 Dec 20 09:33:49.140408 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 398/831] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:33:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:33:49.358058 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-372be7db-c0f5-42fb-8987-70e69933bce9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:49.358670 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-372be7db-c0f5-42fb-8987-70e69933bce9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:49.364961 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-372be7db-c0f5-42fb-8987-70e69933bce9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:49.365411 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-372be7db-c0f5-42fb-8987-70e69933bce9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:49.366189 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-372be7db-c0f5-42fb-8987-70e69933bce9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:49.366627 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-372be7db-c0f5-42fb-8987-70e69933bce9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:49.490817 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-372be7db-c0f5-42fb-8987-70e69933bce9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:49.498474 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-372be7db-c0f5-42fb-8987-70e69933bce9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.144090 Dec 20 09:33:49.499049 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 434/832] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:49 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:49.499442 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-bdaedd34-a9d2-4f24-874e-987006fc72aa tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:49.500350 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-bdaedd34-a9d2-4f24-874e-987006fc72aa tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:49.506389 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bdaedd34-a9d2-4f24-874e-987006fc72aa tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:49.506843 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bdaedd34-a9d2-4f24-874e-987006fc72aa tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:49.507621 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bdaedd34-a9d2-4f24-874e-987006fc72aa tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:49.508083 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bdaedd34-a9d2-4f24-874e-987006fc72aa tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:49.638946 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-bdaedd34-a9d2-4f24-874e-987006fc72aa tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:49.646074 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-bdaedd34-a9d2-4f24-874e-987006fc72aa tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.151542 Dec 20 09:33:49.646643 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 399/833] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:49 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:49.757211 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f51a0249-9db1-4089-8ac0-553d8c93fe9c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:49.757741 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f51a0249-9db1-4089-8ac0-553d8c93fe9c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:49.763775 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f51a0249-9db1-4089-8ac0-553d8c93fe9c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:49.764230 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f51a0249-9db1-4089-8ac0-553d8c93fe9c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:49.765011 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f51a0249-9db1-4089-8ac0-553d8c93fe9c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:49.765460 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f51a0249-9db1-4089-8ac0-553d8c93fe9c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:49.860311 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-89db68b1-dc35-4d88-b2bd-f4fe724896ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:49.860914 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-89db68b1-dc35-4d88-b2bd-f4fe724896ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:49.866776 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-89db68b1-dc35-4d88-b2bd-f4fe724896ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:49.867224 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-89db68b1-dc35-4d88-b2bd-f4fe724896ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:49.868025 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-89db68b1-dc35-4d88-b2bd-f4fe724896ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:49.868462 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-89db68b1-dc35-4d88-b2bd-f4fe724896ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:49.891829 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f51a0249-9db1-4089-8ac0-553d8c93fe9c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:49.899094 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f51a0249-9db1-4089-8ac0-553d8c93fe9c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.145633 Dec 20 09:33:49.899907 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 435/834] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:49 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:49.998474 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-89db68b1-dc35-4d88-b2bd-f4fe724896ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:50.006091 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-89db68b1-dc35-4d88-b2bd-f4fe724896ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:50.007622 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-89db68b1-dc35-4d88-b2bd-f4fe724896ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:50.008757 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-89db68b1-dc35-4d88-b2bd-f4fe724896ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.152785 Dec 20 09:33:50.009310 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 400/835] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:49 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:33:50.515310 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-641798bf-c676-4583-80c0-5f2cdc194ff2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:50.515965 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-641798bf-c676-4583-80c0-5f2cdc194ff2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:50.522235 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-641798bf-c676-4583-80c0-5f2cdc194ff2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:50.522677 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-641798bf-c676-4583-80c0-5f2cdc194ff2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:50.523450 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-641798bf-c676-4583-80c0-5f2cdc194ff2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:50.523935 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-641798bf-c676-4583-80c0-5f2cdc194ff2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:50.658934 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-641798bf-c676-4583-80c0-5f2cdc194ff2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:50.662699 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-53504c77-f2b1-4187-9e08-7236e684ae48 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:50.663231 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-53504c77-f2b1-4187-9e08-7236e684ae48 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:50.666532 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-641798bf-c676-4583-80c0-5f2cdc194ff2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.155485 Dec 20 09:33:50.667119 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 436/836] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:50 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:50.669448 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-53504c77-f2b1-4187-9e08-7236e684ae48 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:50.669889 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-53504c77-f2b1-4187-9e08-7236e684ae48 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:50.670656 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-53504c77-f2b1-4187-9e08-7236e684ae48 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:50.671082 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-53504c77-f2b1-4187-9e08-7236e684ae48 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:50.799286 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-53504c77-f2b1-4187-9e08-7236e684ae48 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:50.807805 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-53504c77-f2b1-4187-9e08-7236e684ae48 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.148664 Dec 20 09:33:50.808406 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 401/837] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:50 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:50.916771 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f9d01f02-b531-48df-8a32-9a47afc240d9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:50.917305 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f9d01f02-b531-48df-8a32-9a47afc240d9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:50.924123 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f9d01f02-b531-48df-8a32-9a47afc240d9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:50.929171 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f9d01f02-b531-48df-8a32-9a47afc240d9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:50.929171 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f9d01f02-b531-48df-8a32-9a47afc240d9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:50.929171 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f9d01f02-b531-48df-8a32-9a47afc240d9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:51.025988 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-095dc79f-a17c-4d13-9dba-90fa66ca446d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:51.026594 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-095dc79f-a17c-4d13-9dba-90fa66ca446d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:51.032690 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-095dc79f-a17c-4d13-9dba-90fa66ca446d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:51.033139 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-095dc79f-a17c-4d13-9dba-90fa66ca446d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:51.033944 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-095dc79f-a17c-4d13-9dba-90fa66ca446d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:51.034378 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-095dc79f-a17c-4d13-9dba-90fa66ca446d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:51.060975 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f9d01f02-b531-48df-8a32-9a47afc240d9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:51.068469 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f9d01f02-b531-48df-8a32-9a47afc240d9 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.155514 Dec 20 09:33:51.071927 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 437/838] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:50 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:51.191917 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-095dc79f-a17c-4d13-9dba-90fa66ca446d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:51.200362 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-095dc79f-a17c-4d13-9dba-90fa66ca446d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:51.202386 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-095dc79f-a17c-4d13-9dba-90fa66ca446d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:51.203579 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-095dc79f-a17c-4d13-9dba-90fa66ca446d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.181233 Dec 20 09:33:51.204467 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 402/839] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:51 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:33:51.312862 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-44af3647-7908-4ac2-8bb9-e3f6efd87e7d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-342777680", "imageRef": "6f828f0b-c445-46a5-9960-492746785ef3", "flavorRef": "452", "networks": [{"uuid": "d5650661-8868-4cf3-8c19-4f747aad5df6"}]}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:33:51.364356 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.network.neutron [None req-44af3647-7908-4ac2-8bb9-e3f6efd87e7d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] validate_networks() for [('d5650661-8868-4cf3-8c19-4f747aad5df6', None, None, None, None, None)] {{(pid=116674) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 09:33:51.683415 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2bb477ac-4c14-4cbd-90af-5d846968a0de tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:51.684048 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2bb477ac-4c14-4cbd-90af-5d846968a0de tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:51.697325 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2bb477ac-4c14-4cbd-90af-5d846968a0de tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:51.698027 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2bb477ac-4c14-4cbd-90af-5d846968a0de tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:51.703191 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2bb477ac-4c14-4cbd-90af-5d846968a0de tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:51.708497 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2bb477ac-4c14-4cbd-90af-5d846968a0de tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:51.737176 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-44af3647-7908-4ac2-8bb9-e3f6efd87e7d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Flavor limits 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 09:33:51.737679 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-44af3647-7908-4ac2-8bb9-e3f6efd87e7d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Image limits 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 09:33:51.737987 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-44af3647-7908-4ac2-8bb9-e3f6efd87e7d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Flavor pref 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 09:33:51.738393 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-44af3647-7908-4ac2-8bb9-e3f6efd87e7d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Image pref 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 09:33:51.738804 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-44af3647-7908-4ac2-8bb9-e3f6efd87e7d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 09:33:51.749946 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-44af3647-7908-4ac2-8bb9-e3f6efd87e7d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:51.750404 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-44af3647-7908-4ac2-8bb9-e3f6efd87e7d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:51.751281 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-44af3647-7908-4ac2-8bb9-e3f6efd87e7d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:51.751831 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-44af3647-7908-4ac2-8bb9-e3f6efd87e7d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:51.770386 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-44af3647-7908-4ac2-8bb9-e3f6efd87e7d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Getting quotas for project b148577d1c274f06aa51efc897f84e33. Resources: {'ram', 'cores', 'instances'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:33:51.774819 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-44af3647-7908-4ac2-8bb9-e3f6efd87e7d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Getting quotas for user 36a8c4cf59e247bd8dfc5e285b20434d and project b148577d1c274f06aa51efc897f84e33. Resources: {'ram', 'cores', 'instances'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:33:51.785897 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-44af3647-7908-4ac2-8bb9-e3f6efd87e7d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Going to run 1 instances... {{(pid=116674) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 09:33:51.788330 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-44af3647-7908-4ac2-8bb9-e3f6efd87e7d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f828f0b-c445-46a5-9960-492746785ef3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 09:33:51.849583 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-2bb477ac-4c14-4cbd-90af-5d846968a0de tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:51.857757 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2bb477ac-4c14-4cbd-90af-5d846968a0de tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.178826 Dec 20 09:33:51.858330 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 403/840] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:51 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:51.870881 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-62291569-0421-46dd-a9cb-7b205e5f8882 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:51.871856 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-62291569-0421-46dd-a9cb-7b205e5f8882 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:51.878048 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-62291569-0421-46dd-a9cb-7b205e5f8882 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:51.878499 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-62291569-0421-46dd-a9cb-7b205e5f8882 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:51.879272 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-62291569-0421-46dd-a9cb-7b205e5f8882 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:51.879733 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-62291569-0421-46dd-a9cb-7b205e5f8882 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:51.962257 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-44af3647-7908-4ac2-8bb9-e3f6efd87e7d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654200 Dec 20 09:33:51.963085 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 438/841] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 20 09:33:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 09:33:51.973185 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-6e66b40d-a177-4072-bf8d-2e2f716f24ba tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:51.973801 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-6e66b40d-a177-4072-bf8d-2e2f716f24ba tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:52.049894 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-6e66b40d-a177-4072-bf8d-2e2f716f24ba tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:52.056958 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-6e66b40d-a177-4072-bf8d-2e2f716f24ba tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1218 microversion: 2.1 time: 0.087335 Dec 20 09:33:52.066134 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 439/842] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:51 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:52.079215 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-62291569-0421-46dd-a9cb-7b205e5f8882 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:52.086406 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-62291569-0421-46dd-a9cb-7b205e5f8882 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.219070 Dec 20 09:33:52.086908 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 404/843] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:51 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:52.088551 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7836657d-7cad-4220-8a48-b3b5c2eef641 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:52.089175 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7836657d-7cad-4220-8a48-b3b5c2eef641 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:52.097139 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7836657d-7cad-4220-8a48-b3b5c2eef641 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:52.097596 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7836657d-7cad-4220-8a48-b3b5c2eef641 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:52.098393 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7836657d-7cad-4220-8a48-b3b5c2eef641 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:52.098830 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7836657d-7cad-4220-8a48-b3b5c2eef641 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:52.221765 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8109f0e0-7fdd-4562-a21e-ca76581e6094 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:52.227094 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8109f0e0-7fdd-4562-a21e-ca76581e6094 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:52.229541 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8109f0e0-7fdd-4562-a21e-ca76581e6094 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:52.230016 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8109f0e0-7fdd-4562-a21e-ca76581e6094 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:52.230804 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8109f0e0-7fdd-4562-a21e-ca76581e6094 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:52.231233 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8109f0e0-7fdd-4562-a21e-ca76581e6094 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:52.483532 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7836657d-7cad-4220-8a48-b3b5c2eef641 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:52.491860 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7836657d-7cad-4220-8a48-b3b5c2eef641 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.409347 Dec 20 09:33:52.493366 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 440/844] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:52 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:52.550168 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8109f0e0-7fdd-4562-a21e-ca76581e6094 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:52.559985 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8109f0e0-7fdd-4562-a21e-ca76581e6094 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:52.561785 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8109f0e0-7fdd-4562-a21e-ca76581e6094 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:52.563342 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8109f0e0-7fdd-4562-a21e-ca76581e6094 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.345423 Dec 20 09:33:52.563946 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 405/845] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:52 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:33:52.875034 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a3338b10-9f70-4240-bfce-32347450435d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:52.875645 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a3338b10-9f70-4240-bfce-32347450435d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:52.882140 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a3338b10-9f70-4240-bfce-32347450435d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:52.882588 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a3338b10-9f70-4240-bfce-32347450435d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:52.883417 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a3338b10-9f70-4240-bfce-32347450435d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:52.883927 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a3338b10-9f70-4240-bfce-32347450435d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:53.030953 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a3338b10-9f70-4240-bfce-32347450435d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:53.037743 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a3338b10-9f70-4240-bfce-32347450435d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.167278 Dec 20 09:33:53.038503 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 441/846] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:52 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:53.073780 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-94e8046a-6488-4b36-a40f-51c81984a3c8 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:53.074532 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-94e8046a-6488-4b36-a40f-51c81984a3c8 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:53.081398 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-94e8046a-6488-4b36-a40f-51c81984a3c8 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:53.081840 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-94e8046a-6488-4b36-a40f-51c81984a3c8 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:53.082803 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-94e8046a-6488-4b36-a40f-51c81984a3c8 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:53.083234 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-94e8046a-6488-4b36-a40f-51c81984a3c8 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:53.105185 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ce988286-9211-4d47-800d-2bb818330272 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:53.105762 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ce988286-9211-4d47-800d-2bb818330272 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:53.113405 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ce988286-9211-4d47-800d-2bb818330272 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:53.113898 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ce988286-9211-4d47-800d-2bb818330272 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:53.114775 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ce988286-9211-4d47-800d-2bb818330272 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:53.115138 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ce988286-9211-4d47-800d-2bb818330272 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:53.160197 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-94e8046a-6488-4b36-a40f-51c81984a3c8 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:53.167875 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-94e8046a-6488-4b36-a40f-51c81984a3c8 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1222 microversion: 2.1 time: 0.097826 Dec 20 09:33:53.168455 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 406/847] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:53 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:53.257642 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ce988286-9211-4d47-800d-2bb818330272 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:53.265548 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ce988286-9211-4d47-800d-2bb818330272 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.164248 Dec 20 09:33:53.266340 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 442/848] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:53 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:53.509081 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9754d26c-e27d-41d3-b208-c128b032dcb8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:53.509691 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9754d26c-e27d-41d3-b208-c128b032dcb8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:53.515879 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9754d26c-e27d-41d3-b208-c128b032dcb8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:53.516448 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9754d26c-e27d-41d3-b208-c128b032dcb8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:53.517274 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9754d26c-e27d-41d3-b208-c128b032dcb8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:53.517728 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9754d26c-e27d-41d3-b208-c128b032dcb8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:53.581338 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b374d7a8-2b3e-45f1-a563-116f9a2e9b3c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:53.582339 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b374d7a8-2b3e-45f1-a563-116f9a2e9b3c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:53.589286 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b374d7a8-2b3e-45f1-a563-116f9a2e9b3c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:53.590082 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b374d7a8-2b3e-45f1-a563-116f9a2e9b3c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:53.591902 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b374d7a8-2b3e-45f1-a563-116f9a2e9b3c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:53.592570 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b374d7a8-2b3e-45f1-a563-116f9a2e9b3c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:53.720981 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-9754d26c-e27d-41d3-b208-c128b032dcb8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:53.731361 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9754d26c-e27d-41d3-b208-c128b032dcb8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.225847 Dec 20 09:33:53.732778 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 407/849] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:53 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:53.776060 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b374d7a8-2b3e-45f1-a563-116f9a2e9b3c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:53.784401 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b374d7a8-2b3e-45f1-a563-116f9a2e9b3c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:53.785880 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b374d7a8-2b3e-45f1-a563-116f9a2e9b3c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:53.787032 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b374d7a8-2b3e-45f1-a563-116f9a2e9b3c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.209638 Dec 20 09:33:53.787593 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 443/850] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:53 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:33:54.054164 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-40063918-7af9-420a-8a8e-dc67ca3a8e08 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:54.054694 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-40063918-7af9-420a-8a8e-dc67ca3a8e08 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:54.061398 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-40063918-7af9-420a-8a8e-dc67ca3a8e08 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:54.061888 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-40063918-7af9-420a-8a8e-dc67ca3a8e08 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:54.062670 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-40063918-7af9-420a-8a8e-dc67ca3a8e08 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:54.063110 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-40063918-7af9-420a-8a8e-dc67ca3a8e08 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:54.186111 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d5ac58d0-b970-4507-9941-c25acfb042f0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:54.186731 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d5ac58d0-b970-4507-9941-c25acfb042f0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:54.193331 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d5ac58d0-b970-4507-9941-c25acfb042f0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:54.195925 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d5ac58d0-b970-4507-9941-c25acfb042f0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:54.196730 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d5ac58d0-b970-4507-9941-c25acfb042f0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:54.197167 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d5ac58d0-b970-4507-9941-c25acfb042f0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:54.207863 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-40063918-7af9-420a-8a8e-dc67ca3a8e08 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:54.215323 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-40063918-7af9-420a-8a8e-dc67ca3a8e08 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.164878 Dec 20 09:33:54.216495 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 408/851] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:54 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:54.259871 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d5ac58d0-b970-4507-9941-c25acfb042f0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:54.267340 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d5ac58d0-b970-4507-9941-c25acfb042f0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1222 microversion: 2.1 time: 0.085474 Dec 20 09:33:54.267945 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 444/852] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:54 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:54.284142 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ce8fa0b2-c868-45a6-818d-960e950e6596 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:54.285038 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ce8fa0b2-c868-45a6-818d-960e950e6596 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:54.291062 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ce8fa0b2-c868-45a6-818d-960e950e6596 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:54.291507 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ce8fa0b2-c868-45a6-818d-960e950e6596 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:54.292325 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ce8fa0b2-c868-45a6-818d-960e950e6596 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:54.292763 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ce8fa0b2-c868-45a6-818d-960e950e6596 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:54.430679 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ce8fa0b2-c868-45a6-818d-960e950e6596 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:54.430679 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ce8fa0b2-c868-45a6-818d-960e950e6596 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.147166 Dec 20 09:33:54.430679 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 409/853] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:54 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:54.750630 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4b77f121-b50c-4446-8349-673b8641d472 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:54.751238 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-4b77f121-b50c-4446-8349-673b8641d472 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:54.757247 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4b77f121-b50c-4446-8349-673b8641d472 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:54.757687 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4b77f121-b50c-4446-8349-673b8641d472 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:54.758461 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4b77f121-b50c-4446-8349-673b8641d472 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:54.758889 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4b77f121-b50c-4446-8349-673b8641d472 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:54.805363 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d01a60b7-6d19-440a-b633-f097b14a15dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:54.806073 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d01a60b7-6d19-440a-b633-f097b14a15dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:54.812570 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d01a60b7-6d19-440a-b633-f097b14a15dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:54.813065 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d01a60b7-6d19-440a-b633-f097b14a15dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:54.813953 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d01a60b7-6d19-440a-b633-f097b14a15dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:54.814456 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d01a60b7-6d19-440a-b633-f097b14a15dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:54.932499 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-4b77f121-b50c-4446-8349-673b8641d472 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:54.943124 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-4b77f121-b50c-4446-8349-673b8641d472 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.197249 Dec 20 09:33:54.944058 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 445/854] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:54 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:55.007328 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d01a60b7-6d19-440a-b633-f097b14a15dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:55.015973 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d01a60b7-6d19-440a-b633-f097b14a15dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:55.017463 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d01a60b7-6d19-440a-b633-f097b14a15dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:55.018641 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d01a60b7-6d19-440a-b633-f097b14a15dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.217063 Dec 20 09:33:55.019228 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 410/855] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:54 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:33:55.231717 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-294a7879-acec-4783-aa79-b933eede401d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:55.232336 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-294a7879-acec-4783-aa79-b933eede401d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:55.239090 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-294a7879-acec-4783-aa79-b933eede401d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:55.239549 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-294a7879-acec-4783-aa79-b933eede401d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:55.240366 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-294a7879-acec-4783-aa79-b933eede401d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:55.240801 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-294a7879-acec-4783-aa79-b933eede401d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:55.283557 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f3deb360-6f7c-45df-87de-03b9aee67bec tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:55.284192 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f3deb360-6f7c-45df-87de-03b9aee67bec tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:55.290734 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f3deb360-6f7c-45df-87de-03b9aee67bec tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:55.291192 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f3deb360-6f7c-45df-87de-03b9aee67bec tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:55.292017 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f3deb360-6f7c-45df-87de-03b9aee67bec tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:55.292456 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f3deb360-6f7c-45df-87de-03b9aee67bec tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:55.361001 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f3deb360-6f7c-45df-87de-03b9aee67bec tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:55.368358 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f3deb360-6f7c-45df-87de-03b9aee67bec tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1222 microversion: 2.1 time: 0.088433 Dec 20 09:33:55.369119 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 411/856] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:55 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:55.423029 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-294a7879-acec-4783-aa79-b933eede401d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:55.433006 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-294a7879-acec-4783-aa79-b933eede401d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.204938 Dec 20 09:33:55.433949 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 446/857] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:55 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:55.445381 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-299d1790-1dc2-4393-9d3f-d8f516565da7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:55.445991 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-299d1790-1dc2-4393-9d3f-d8f516565da7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:55.452479 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-299d1790-1dc2-4393-9d3f-d8f516565da7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:55.452926 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-299d1790-1dc2-4393-9d3f-d8f516565da7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:55.453699 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-299d1790-1dc2-4393-9d3f-d8f516565da7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:55.454166 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-299d1790-1dc2-4393-9d3f-d8f516565da7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:55.583083 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-299d1790-1dc2-4393-9d3f-d8f516565da7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:55.590505 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-299d1790-1dc2-4393-9d3f-d8f516565da7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.148842 Dec 20 09:33:55.600401 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 412/858] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:55 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:55.960826 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0585b845-c61f-4de8-8347-1006804d18a5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:55.961433 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0585b845-c61f-4de8-8347-1006804d18a5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:55.967637 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0585b845-c61f-4de8-8347-1006804d18a5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:55.968118 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0585b845-c61f-4de8-8347-1006804d18a5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:55.968903 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0585b845-c61f-4de8-8347-1006804d18a5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:55.969336 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0585b845-c61f-4de8-8347-1006804d18a5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:56.037343 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-eeb02939-d2e5-4834-803a-89c194e3fcdc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:56.038071 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-eeb02939-d2e5-4834-803a-89c194e3fcdc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:56.044745 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eeb02939-d2e5-4834-803a-89c194e3fcdc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:56.045292 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eeb02939-d2e5-4834-803a-89c194e3fcdc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:56.046169 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eeb02939-d2e5-4834-803a-89c194e3fcdc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:56.046680 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eeb02939-d2e5-4834-803a-89c194e3fcdc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:56.127609 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-0585b845-c61f-4de8-8347-1006804d18a5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:56.139611 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0585b845-c61f-4de8-8347-1006804d18a5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.182261 Dec 20 09:33:56.140510 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 447/859] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:55 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:56.215873 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-eeb02939-d2e5-4834-803a-89c194e3fcdc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:56.224530 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-eeb02939-d2e5-4834-803a-89c194e3fcdc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:56.225994 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-eeb02939-d2e5-4834-803a-89c194e3fcdc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:56.227130 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-eeb02939-d2e5-4834-803a-89c194e3fcdc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.193573 Dec 20 09:33:56.227710 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 413/860] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:56 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:33:56.384953 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b3e9a6f1-3bd6-4776-ab31-80ab50fd4cf0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:56.385604 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b3e9a6f1-3bd6-4776-ab31-80ab50fd4cf0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:56.391949 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b3e9a6f1-3bd6-4776-ab31-80ab50fd4cf0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:56.392398 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b3e9a6f1-3bd6-4776-ab31-80ab50fd4cf0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:56.393177 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b3e9a6f1-3bd6-4776-ab31-80ab50fd4cf0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:56.393608 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b3e9a6f1-3bd6-4776-ab31-80ab50fd4cf0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:56.449649 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f7cdfbd5-8090-46c5-8c49-7d5edad891a3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:56.450893 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f7cdfbd5-8090-46c5-8c49-7d5edad891a3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:56.454300 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b3e9a6f1-3bd6-4776-ab31-80ab50fd4cf0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:56.458246 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f7cdfbd5-8090-46c5-8c49-7d5edad891a3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:56.458700 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f7cdfbd5-8090-46c5-8c49-7d5edad891a3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:56.459493 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f7cdfbd5-8090-46c5-8c49-7d5edad891a3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:56.459959 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f7cdfbd5-8090-46c5-8c49-7d5edad891a3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:56.462444 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b3e9a6f1-3bd6-4776-ab31-80ab50fd4cf0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1222 microversion: 2.1 time: 0.081084 Dec 20 09:33:56.463148 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 448/861] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:56 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:56.596234 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f7cdfbd5-8090-46c5-8c49-7d5edad891a3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:56.608115 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-6649699e-72ab-48f4-8b06-d06431386806 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:56.608823 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-6649699e-72ab-48f4-8b06-d06431386806 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:56.612846 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f7cdfbd5-8090-46c5-8c49-7d5edad891a3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.166899 Dec 20 09:33:56.613437 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 414/862] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:56 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:56.614952 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6649699e-72ab-48f4-8b06-d06431386806 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:56.615471 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6649699e-72ab-48f4-8b06-d06431386806 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:56.616447 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6649699e-72ab-48f4-8b06-d06431386806 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:56.616980 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6649699e-72ab-48f4-8b06-d06431386806 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:56.746947 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-6649699e-72ab-48f4-8b06-d06431386806 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:56.754456 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-6649699e-72ab-48f4-8b06-d06431386806 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.150630 Dec 20 09:33:56.755018 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 449/863] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:56 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:57.156526 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1da1ef7d-bdd1-4620-a399-8bc7e67c6eb2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:57.157412 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1da1ef7d-bdd1-4620-a399-8bc7e67c6eb2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:57.163369 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1da1ef7d-bdd1-4620-a399-8bc7e67c6eb2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:57.163858 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1da1ef7d-bdd1-4620-a399-8bc7e67c6eb2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:57.164653 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1da1ef7d-bdd1-4620-a399-8bc7e67c6eb2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:57.165093 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1da1ef7d-bdd1-4620-a399-8bc7e67c6eb2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:57.247032 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9cb0cd1f-015e-4ed5-aa4e-394580979f7b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:57.247032 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9cb0cd1f-015e-4ed5-aa4e-394580979f7b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:57.258610 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9cb0cd1f-015e-4ed5-aa4e-394580979f7b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:57.258610 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9cb0cd1f-015e-4ed5-aa4e-394580979f7b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:57.258610 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9cb0cd1f-015e-4ed5-aa4e-394580979f7b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:57.258968 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9cb0cd1f-015e-4ed5-aa4e-394580979f7b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:57.315012 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1da1ef7d-bdd1-4620-a399-8bc7e67c6eb2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:57.322502 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1da1ef7d-bdd1-4620-a399-8bc7e67c6eb2 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.170177 Dec 20 09:33:57.323385 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 415/864] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:57 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:57.406264 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-9cb0cd1f-015e-4ed5-aa4e-394580979f7b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:57.414579 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-9cb0cd1f-015e-4ed5-aa4e-394580979f7b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:57.416093 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-9cb0cd1f-015e-4ed5-aa4e-394580979f7b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:57.417229 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9cb0cd1f-015e-4ed5-aa4e-394580979f7b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.175621 Dec 20 09:33:57.417959 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 450/865] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:57 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:33:57.479348 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-7dc76ced-9b81-4237-8cbf-ffc8951f7661 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:57.480016 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-7dc76ced-9b81-4237-8cbf-ffc8951f7661 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:57.486188 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7dc76ced-9b81-4237-8cbf-ffc8951f7661 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:57.486626 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7dc76ced-9b81-4237-8cbf-ffc8951f7661 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:57.487386 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7dc76ced-9b81-4237-8cbf-ffc8951f7661 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:57.487850 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7dc76ced-9b81-4237-8cbf-ffc8951f7661 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:57.548489 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-7dc76ced-9b81-4237-8cbf-ffc8951f7661 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:57.555748 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-7dc76ced-9b81-4237-8cbf-ffc8951f7661 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1222 microversion: 2.1 time: 0.079997 Dec 20 09:33:57.556945 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 416/866] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:57 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:57.629238 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7f89e65e-c210-42b0-9e3d-aa0cf55cb3ba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:57.630188 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7f89e65e-c210-42b0-9e3d-aa0cf55cb3ba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:57.640303 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7f89e65e-c210-42b0-9e3d-aa0cf55cb3ba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:57.641468 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7f89e65e-c210-42b0-9e3d-aa0cf55cb3ba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:57.642666 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7f89e65e-c210-42b0-9e3d-aa0cf55cb3ba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:57.643274 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7f89e65e-c210-42b0-9e3d-aa0cf55cb3ba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:57.773099 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-7af76780-ecf9-4cdb-9a2f-1b0835335883 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:57.773746 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-7af76780-ecf9-4cdb-9a2f-1b0835335883 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:57.781019 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7af76780-ecf9-4cdb-9a2f-1b0835335883 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:57.781576 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7af76780-ecf9-4cdb-9a2f-1b0835335883 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:57.782375 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7af76780-ecf9-4cdb-9a2f-1b0835335883 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:57.782811 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7af76780-ecf9-4cdb-9a2f-1b0835335883 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:57.788871 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7f89e65e-c210-42b0-9e3d-aa0cf55cb3ba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:57.797651 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7f89e65e-c210-42b0-9e3d-aa0cf55cb3ba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.172244 Dec 20 09:33:57.807203 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 451/867] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:57 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:57.930706 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-7af76780-ecf9-4cdb-9a2f-1b0835335883 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:57.939631 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-7af76780-ecf9-4cdb-9a2f-1b0835335883 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.171493 Dec 20 09:33:57.940611 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 417/868] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:57 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:58.339578 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-543014ff-fa46-4c9e-9dd9-3417c84960ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:58.340227 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-543014ff-fa46-4c9e-9dd9-3417c84960ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:58.358131 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-543014ff-fa46-4c9e-9dd9-3417c84960ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:58.358580 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-543014ff-fa46-4c9e-9dd9-3417c84960ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:58.359370 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-543014ff-fa46-4c9e-9dd9-3417c84960ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:58.359828 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-543014ff-fa46-4c9e-9dd9-3417c84960ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:58.445469 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0e959cc8-3b9a-486f-89d2-eb890259bc70 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:58.446359 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0e959cc8-3b9a-486f-89d2-eb890259bc70 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:58.452777 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0e959cc8-3b9a-486f-89d2-eb890259bc70 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:58.453297 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0e959cc8-3b9a-486f-89d2-eb890259bc70 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:58.454178 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0e959cc8-3b9a-486f-89d2-eb890259bc70 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:58.454684 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0e959cc8-3b9a-486f-89d2-eb890259bc70 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:58.547451 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-543014ff-fa46-4c9e-9dd9-3417c84960ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:58.558880 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-543014ff-fa46-4c9e-9dd9-3417c84960ca tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.222913 Dec 20 09:33:58.563990 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 452/869] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:58 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:58.571945 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-61c0d21b-9960-439f-b427-11b5a51f3715 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:58.572627 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-61c0d21b-9960-439f-b427-11b5a51f3715 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:58.578772 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-61c0d21b-9960-439f-b427-11b5a51f3715 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:58.579298 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-61c0d21b-9960-439f-b427-11b5a51f3715 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:58.580272 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-61c0d21b-9960-439f-b427-11b5a51f3715 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:58.580703 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-61c0d21b-9960-439f-b427-11b5a51f3715 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:58.622983 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-0e959cc8-3b9a-486f-89d2-eb890259bc70 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:58.631272 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-0e959cc8-3b9a-486f-89d2-eb890259bc70 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:58.633114 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-0e959cc8-3b9a-486f-89d2-eb890259bc70 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:58.634412 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0e959cc8-3b9a-486f-89d2-eb890259bc70 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.192520 Dec 20 09:33:58.634931 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 418/870] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:58 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:33:58.648045 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-61c0d21b-9960-439f-b427-11b5a51f3715 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:58.657463 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-61c0d21b-9960-439f-b427-11b5a51f3715 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1222 microversion: 2.1 time: 0.088921 Dec 20 09:33:58.667449 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 453/871] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:58 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:58.814522 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-257584bd-8a5f-493c-bd09-24a2680fd5b9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:58.815251 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-257584bd-8a5f-493c-bd09-24a2680fd5b9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:58.821266 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-257584bd-8a5f-493c-bd09-24a2680fd5b9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:58.821948 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-257584bd-8a5f-493c-bd09-24a2680fd5b9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:58.822723 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-257584bd-8a5f-493c-bd09-24a2680fd5b9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:58.823347 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-257584bd-8a5f-493c-bd09-24a2680fd5b9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:58.956959 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-2b506e22-5e77-4309-a7ae-83796b66aa15 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:58.957862 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-2b506e22-5e77-4309-a7ae-83796b66aa15 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:58.964391 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-257584bd-8a5f-493c-bd09-24a2680fd5b9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:58.966912 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2b506e22-5e77-4309-a7ae-83796b66aa15 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:58.967366 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2b506e22-5e77-4309-a7ae-83796b66aa15 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:58.968194 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2b506e22-5e77-4309-a7ae-83796b66aa15 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:58.968631 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2b506e22-5e77-4309-a7ae-83796b66aa15 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:58.971472 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-257584bd-8a5f-493c-bd09-24a2680fd5b9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.160536 Dec 20 09:33:58.972067 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 419/872] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:58 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:59.106605 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-2b506e22-5e77-4309-a7ae-83796b66aa15 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:59.114323 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-2b506e22-5e77-4309-a7ae-83796b66aa15 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.160983 Dec 20 09:33:59.114894 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 454/873] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:58 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:33:59.576563 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f3fe5b65-2e60-48d7-9b9f-8349d54eebab tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:59.577093 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f3fe5b65-2e60-48d7-9b9f-8349d54eebab tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:59.583684 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f3fe5b65-2e60-48d7-9b9f-8349d54eebab tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:59.584399 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f3fe5b65-2e60-48d7-9b9f-8349d54eebab tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:59.585419 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f3fe5b65-2e60-48d7-9b9f-8349d54eebab tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:59.585861 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f3fe5b65-2e60-48d7-9b9f-8349d54eebab tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:59.652866 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-695378ee-c136-46a2-a5b2-47b05a86d2dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:59.653507 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-695378ee-c136-46a2-a5b2-47b05a86d2dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:59.659892 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-695378ee-c136-46a2-a5b2-47b05a86d2dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:59.664349 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-695378ee-c136-46a2-a5b2-47b05a86d2dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:59.664349 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-695378ee-c136-46a2-a5b2-47b05a86d2dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:59.664349 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-695378ee-c136-46a2-a5b2-47b05a86d2dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:59.726545 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f3fe5b65-2e60-48d7-9b9f-8349d54eebab tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:59.733916 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f3fe5b65-2e60-48d7-9b9f-8349d54eebab tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.161781 Dec 20 09:33:59.734484 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 420/874] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:59 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:59.738658 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-3b8203bf-a195-454d-b42e-3aa591a1df9e tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:59.739247 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-3b8203bf-a195-454d-b42e-3aa591a1df9e tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:59.744719 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3b8203bf-a195-454d-b42e-3aa591a1df9e tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:59.745208 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3b8203bf-a195-454d-b42e-3aa591a1df9e tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:59.745990 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3b8203bf-a195-454d-b42e-3aa591a1df9e tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:59.746440 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3b8203bf-a195-454d-b42e-3aa591a1df9e tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:59.816910 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-3b8203bf-a195-454d-b42e-3aa591a1df9e tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:59.826766 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-3b8203bf-a195-454d-b42e-3aa591a1df9e tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1222 microversion: 2.1 time: 0.091161 Dec 20 09:33:59.836947 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 421/875] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:59 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1222 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:33:59.888835 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-695378ee-c136-46a2-a5b2-47b05a86d2dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:59.897167 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-695378ee-c136-46a2-a5b2-47b05a86d2dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:59.898661 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-695378ee-c136-46a2-a5b2-47b05a86d2dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:33:59.899847 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-695378ee-c136-46a2-a5b2-47b05a86d2dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.250912 Dec 20 09:33:59.900407 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 455/876] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:33:59 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:33:59.988723 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6365d5f3-0c29-4ec2-883c-02fd229c81da tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:33:59.989363 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6365d5f3-0c29-4ec2-883c-02fd229c81da tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:33:59.995580 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6365d5f3-0c29-4ec2-883c-02fd229c81da tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:59.996057 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6365d5f3-0c29-4ec2-883c-02fd229c81da tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:33:59.996848 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6365d5f3-0c29-4ec2-883c-02fd229c81da tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:33:59.997921 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6365d5f3-0c29-4ec2-883c-02fd229c81da tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:00.128351 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6365d5f3-0c29-4ec2-883c-02fd229c81da tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:00.130459 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-aa848941-d5b4-42cd-bcae-f0468339bbe7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:00.131084 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-aa848941-d5b4-42cd-bcae-f0468339bbe7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:00.137167 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-aa848941-d5b4-42cd-bcae-f0468339bbe7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:00.137622 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-aa848941-d5b4-42cd-bcae-f0468339bbe7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:00.138916 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-aa848941-d5b4-42cd-bcae-f0468339bbe7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:00.139350 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-aa848941-d5b4-42cd-bcae-f0468339bbe7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:00.141941 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6365d5f3-0c29-4ec2-883c-02fd229c81da tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.156729 Dec 20 09:34:00.142772 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 422/877] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:33:59 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:00.280959 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-aa848941-d5b4-42cd-bcae-f0468339bbe7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:00.288588 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-aa848941-d5b4-42cd-bcae-f0468339bbe7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.161770 Dec 20 09:34:00.289261 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 456/878] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:00 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:00.751612 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f68d5013-ec00-412a-8630-68ca1ffa2cad tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:00.752419 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f68d5013-ec00-412a-8630-68ca1ffa2cad tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:00.759766 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f68d5013-ec00-412a-8630-68ca1ffa2cad tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:00.760225 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f68d5013-ec00-412a-8630-68ca1ffa2cad tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:00.761020 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f68d5013-ec00-412a-8630-68ca1ffa2cad tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:00.761459 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f68d5013-ec00-412a-8630-68ca1ffa2cad tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:00.846773 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d4ee1458-7baf-4381-9e13-198a139f66ee tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:00.847396 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d4ee1458-7baf-4381-9e13-198a139f66ee tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:00.853964 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d4ee1458-7baf-4381-9e13-198a139f66ee tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:00.854446 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d4ee1458-7baf-4381-9e13-198a139f66ee tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:00.855384 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d4ee1458-7baf-4381-9e13-198a139f66ee tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:00.855856 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d4ee1458-7baf-4381-9e13-198a139f66ee tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:00.927996 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f68d5013-ec00-412a-8630-68ca1ffa2cad tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:00.929837 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d4ee1458-7baf-4381-9e13-198a139f66ee tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:00.937413 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f68d5013-ec00-412a-8630-68ca1ffa2cad tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.190084 Dec 20 09:34:00.938039 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d4ee1458-7baf-4381-9e13-198a139f66ee tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1222 microversion: 2.1 time: 0.098242 Dec 20 09:34:00.938866 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 457/879] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:00 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:34:00.939754 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 423/880] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:00 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:00.945162 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8b3a645c-dc92-4f29-8f84-a177995a2db8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:00.945902 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-8b3a645c-dc92-4f29-8f84-a177995a2db8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:00.951948 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8b3a645c-dc92-4f29-8f84-a177995a2db8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:00.952397 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8b3a645c-dc92-4f29-8f84-a177995a2db8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:00.953186 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8b3a645c-dc92-4f29-8f84-a177995a2db8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:00.953620 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8b3a645c-dc92-4f29-8f84-a177995a2db8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:01.109396 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-8b3a645c-dc92-4f29-8f84-a177995a2db8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:01.117442 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-8b3a645c-dc92-4f29-8f84-a177995a2db8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:01.118937 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-8b3a645c-dc92-4f29-8f84-a177995a2db8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:01.120130 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8b3a645c-dc92-4f29-8f84-a177995a2db8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.178518 Dec 20 09:34:01.120694 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 458/881] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:00 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:01.158585 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d31bef61-4062-4387-8f48-edc31083fc94 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:01.159224 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d31bef61-4062-4387-8f48-edc31083fc94 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:01.165105 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d31bef61-4062-4387-8f48-edc31083fc94 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:01.165550 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d31bef61-4062-4387-8f48-edc31083fc94 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:01.166343 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d31bef61-4062-4387-8f48-edc31083fc94 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:01.166778 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d31bef61-4062-4387-8f48-edc31083fc94 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:01.305953 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-01301eb1-0e1f-4e72-b573-23c6d589b8aa tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:01.306696 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-01301eb1-0e1f-4e72-b573-23c6d589b8aa tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:01.307698 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d31bef61-4062-4387-8f48-edc31083fc94 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:01.312911 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-01301eb1-0e1f-4e72-b573-23c6d589b8aa tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:01.313443 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-01301eb1-0e1f-4e72-b573-23c6d589b8aa tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:01.314358 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-01301eb1-0e1f-4e72-b573-23c6d589b8aa tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:01.314865 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-01301eb1-0e1f-4e72-b573-23c6d589b8aa tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:01.316062 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d31bef61-4062-4387-8f48-edc31083fc94 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.161073 Dec 20 09:34:01.316640 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 424/882] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:01 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:01.455930 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-01301eb1-0e1f-4e72-b573-23c6d589b8aa tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:01.463122 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-01301eb1-0e1f-4e72-b573-23c6d589b8aa tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.160920 Dec 20 09:34:01.463716 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 459/883] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:01 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:34:01.956195 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a0ac5d44-7a73-494d-a419-d700f07b32a1 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:01.956788 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a0ac5d44-7a73-494d-a419-d700f07b32a1 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:01.957941 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9883a489-1a82-4867-8ab1-4e01c5a73ae4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:01.958604 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9883a489-1a82-4867-8ab1-4e01c5a73ae4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:01.963511 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a0ac5d44-7a73-494d-a419-d700f07b32a1 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:01.963997 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a0ac5d44-7a73-494d-a419-d700f07b32a1 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:01.964779 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a0ac5d44-7a73-494d-a419-d700f07b32a1 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:01.965197 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9883a489-1a82-4867-8ab1-4e01c5a73ae4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:01.965322 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a0ac5d44-7a73-494d-a419-d700f07b32a1 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:01.965641 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9883a489-1a82-4867-8ab1-4e01c5a73ae4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:01.966418 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9883a489-1a82-4867-8ab1-4e01c5a73ae4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:01.966845 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9883a489-1a82-4867-8ab1-4e01c5a73ae4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:02.040417 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a0ac5d44-7a73-494d-a419-d700f07b32a1 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:02.048369 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a0ac5d44-7a73-494d-a419-d700f07b32a1 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1222 microversion: 2.1 time: 0.096010 Dec 20 09:34:02.049435 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 425/884] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:01 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:34:02.135704 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-9883a489-1a82-4867-8ab1-4e01c5a73ae4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:02.138673 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ddc673d1-3607-4925-9caf-c493de787161 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:02.139364 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ddc673d1-3607-4925-9caf-c493de787161 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:02.144364 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9883a489-1a82-4867-8ab1-4e01c5a73ae4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.190197 Dec 20 09:34:02.145093 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 460/885] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:01 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:34:02.150317 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ddc673d1-3607-4925-9caf-c493de787161 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:02.154002 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ddc673d1-3607-4925-9caf-c493de787161 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:02.154002 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ddc673d1-3607-4925-9caf-c493de787161 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:02.154002 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ddc673d1-3607-4925-9caf-c493de787161 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:02.290865 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ddc673d1-3607-4925-9caf-c493de787161 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:02.299581 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ddc673d1-3607-4925-9caf-c493de787161 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:02.301084 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ddc673d1-3607-4925-9caf-c493de787161 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:02.302272 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ddc673d1-3607-4925-9caf-c493de787161 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.167955 Dec 20 09:34:02.302855 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 426/886] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:02 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:34:02.339674 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0488c4c9-efb1-416d-bf54-3154cbe3a0d9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:02.340295 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0488c4c9-efb1-416d-bf54-3154cbe3a0d9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:02.346218 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0488c4c9-efb1-416d-bf54-3154cbe3a0d9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:02.346665 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0488c4c9-efb1-416d-bf54-3154cbe3a0d9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:02.347440 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0488c4c9-efb1-416d-bf54-3154cbe3a0d9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:02.347915 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0488c4c9-efb1-416d-bf54-3154cbe3a0d9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:02.479768 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-7fa04016-a1ee-4fac-bd71-bbd6e6b0a13b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:02.480459 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-7fa04016-a1ee-4fac-bd71-bbd6e6b0a13b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:02.483366 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-0488c4c9-efb1-416d-bf54-3154cbe3a0d9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:02.490321 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7fa04016-a1ee-4fac-bd71-bbd6e6b0a13b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:02.490687 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7fa04016-a1ee-4fac-bd71-bbd6e6b0a13b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:02.491987 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7fa04016-a1ee-4fac-bd71-bbd6e6b0a13b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:02.492434 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7fa04016-a1ee-4fac-bd71-bbd6e6b0a13b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:02.498123 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0488c4c9-efb1-416d-bf54-3154cbe3a0d9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.161752 Dec 20 09:34:02.498895 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 461/887] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:02 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:02.622635 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-7fa04016-a1ee-4fac-bd71-bbd6e6b0a13b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:02.630086 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-7fa04016-a1ee-4fac-bd71-bbd6e6b0a13b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.154029 Dec 20 09:34:02.630653 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 427/888] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:02 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:34:03.066569 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1f2086dc-5642-4771-afd1-472f832d2bb8 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:03.067127 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-1f2086dc-5642-4771-afd1-472f832d2bb8 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:03.073789 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1f2086dc-5642-4771-afd1-472f832d2bb8 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:03.074252 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1f2086dc-5642-4771-afd1-472f832d2bb8 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:03.076734 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1f2086dc-5642-4771-afd1-472f832d2bb8 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:03.077186 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1f2086dc-5642-4771-afd1-472f832d2bb8 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:03.138651 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1f2086dc-5642-4771-afd1-472f832d2bb8 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:03.145933 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1f2086dc-5642-4771-afd1-472f832d2bb8 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1222 microversion: 2.1 time: 0.083087 Dec 20 09:34:03.146516 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 462/889] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:03 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:03.161352 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b7f7871f-2733-47cf-a25c-ed827ad0707b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:03.162176 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b7f7871f-2733-47cf-a25c-ed827ad0707b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:03.168813 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b7f7871f-2733-47cf-a25c-ed827ad0707b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:03.169292 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b7f7871f-2733-47cf-a25c-ed827ad0707b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:03.170075 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b7f7871f-2733-47cf-a25c-ed827ad0707b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:03.170500 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b7f7871f-2733-47cf-a25c-ed827ad0707b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:03.306783 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b7f7871f-2733-47cf-a25c-ed827ad0707b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:03.315801 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b7f7871f-2733-47cf-a25c-ed827ad0707b tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.157728 Dec 20 09:34:03.320731 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-6ed77adb-3c3e-487d-be8d-70378c602d51 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:03.321400 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-6ed77adb-3c3e-487d-be8d-70378c602d51 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:03.324074 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 428/890] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:03 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:03.328226 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6ed77adb-3c3e-487d-be8d-70378c602d51 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:03.328675 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6ed77adb-3c3e-487d-be8d-70378c602d51 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:03.329470 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6ed77adb-3c3e-487d-be8d-70378c602d51 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:03.329907 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6ed77adb-3c3e-487d-be8d-70378c602d51 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:03.470880 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-6ed77adb-3c3e-487d-be8d-70378c602d51 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:03.480965 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-6ed77adb-3c3e-487d-be8d-70378c602d51 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:03.482678 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-6ed77adb-3c3e-487d-be8d-70378c602d51 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:03.484095 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-6ed77adb-3c3e-487d-be8d-70378c602d51 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.166810 Dec 20 09:34:03.484441 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 463/891] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:03 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:03.514796 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d68b5b99-7c7f-4328-a1c4-cdb7a4e54969 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:03.515414 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d68b5b99-7c7f-4328-a1c4-cdb7a4e54969 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:03.521703 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d68b5b99-7c7f-4328-a1c4-cdb7a4e54969 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:03.522151 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d68b5b99-7c7f-4328-a1c4-cdb7a4e54969 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:03.522927 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d68b5b99-7c7f-4328-a1c4-cdb7a4e54969 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:03.523360 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d68b5b99-7c7f-4328-a1c4-cdb7a4e54969 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:03.647322 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-404834f2-902c-42c6-9da2-0223cf2f8e99 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:03.647963 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-404834f2-902c-42c6-9da2-0223cf2f8e99 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:03.654284 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-404834f2-902c-42c6-9da2-0223cf2f8e99 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:03.654734 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-404834f2-902c-42c6-9da2-0223cf2f8e99 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:03.655566 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-404834f2-902c-42c6-9da2-0223cf2f8e99 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:03.656025 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-404834f2-902c-42c6-9da2-0223cf2f8e99 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:03.661235 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d68b5b99-7c7f-4328-a1c4-cdb7a4e54969 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:03.669466 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d68b5b99-7c7f-4328-a1c4-cdb7a4e54969 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.158224 Dec 20 09:34:03.670213 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 429/892] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:03 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:03.793996 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-404834f2-902c-42c6-9da2-0223cf2f8e99 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:03.801104 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-404834f2-902c-42c6-9da2-0223cf2f8e99 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.157519 Dec 20 09:34:03.801680 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 464/893] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:03 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:34:04.162402 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4ebd64bb-f8ec-40fc-8201-b3655022a730 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:04.163023 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4ebd64bb-f8ec-40fc-8201-b3655022a730 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:04.170364 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4ebd64bb-f8ec-40fc-8201-b3655022a730 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:04.170860 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4ebd64bb-f8ec-40fc-8201-b3655022a730 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:04.171678 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4ebd64bb-f8ec-40fc-8201-b3655022a730 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:04.174418 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4ebd64bb-f8ec-40fc-8201-b3655022a730 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:04.233299 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-4ebd64bb-f8ec-40fc-8201-b3655022a730 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:04.240745 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4ebd64bb-f8ec-40fc-8201-b3655022a730 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1222 microversion: 2.1 time: 0.082383 Dec 20 09:34:04.251834 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 430/894] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:04 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:04.332064 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d84c495b-6d19-4ee9-982d-64473835771c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:04.332672 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d84c495b-6d19-4ee9-982d-64473835771c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:04.339684 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d84c495b-6d19-4ee9-982d-64473835771c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:04.340249 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d84c495b-6d19-4ee9-982d-64473835771c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:04.341091 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d84c495b-6d19-4ee9-982d-64473835771c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:04.341532 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d84c495b-6d19-4ee9-982d-64473835771c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:04.476776 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d84c495b-6d19-4ee9-982d-64473835771c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:04.484782 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d84c495b-6d19-4ee9-982d-64473835771c tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.156422 Dec 20 09:34:04.485285 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 465/895] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:04 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:04.501847 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1614c24e-753a-4cd8-9772-e35e6095388d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:04.504308 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1614c24e-753a-4cd8-9772-e35e6095388d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:04.508236 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1614c24e-753a-4cd8-9772-e35e6095388d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:04.508675 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1614c24e-753a-4cd8-9772-e35e6095388d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:04.509433 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1614c24e-753a-4cd8-9772-e35e6095388d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:04.509859 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1614c24e-753a-4cd8-9772-e35e6095388d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:04.637137 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1614c24e-753a-4cd8-9772-e35e6095388d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:04.645509 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1614c24e-753a-4cd8-9772-e35e6095388d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:04.646977 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1614c24e-753a-4cd8-9772-e35e6095388d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:04.648258 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1614c24e-753a-4cd8-9772-e35e6095388d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.150069 Dec 20 09:34:04.648849 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 431/896] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:04 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:04.686486 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-368f29c8-e1a7-4704-a6dd-a3347d8fcd8f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:04.687120 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-368f29c8-e1a7-4704-a6dd-a3347d8fcd8f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:04.693031 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-368f29c8-e1a7-4704-a6dd-a3347d8fcd8f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:04.693483 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-368f29c8-e1a7-4704-a6dd-a3347d8fcd8f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:04.694317 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-368f29c8-e1a7-4704-a6dd-a3347d8fcd8f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:04.694773 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-368f29c8-e1a7-4704-a6dd-a3347d8fcd8f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:04.818078 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c1711350-c4f9-40af-b04c-588ae65630a7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:04.818822 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c1711350-c4f9-40af-b04c-588ae65630a7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:04.821979 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-368f29c8-e1a7-4704-a6dd-a3347d8fcd8f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:04.824662 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c1711350-c4f9-40af-b04c-588ae65630a7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:04.825110 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c1711350-c4f9-40af-b04c-588ae65630a7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:04.826464 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c1711350-c4f9-40af-b04c-588ae65630a7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:04.826897 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c1711350-c4f9-40af-b04c-588ae65630a7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:04.829960 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-368f29c8-e1a7-4704-a6dd-a3347d8fcd8f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.147718 Dec 20 09:34:04.830659 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 466/897] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:04 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:04.954730 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-c1711350-c4f9-40af-b04c-588ae65630a7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:04.961837 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c1711350-c4f9-40af-b04c-588ae65630a7 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.147444 Dec 20 09:34:04.962402 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 432/898] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:04 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:34:05.259056 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b122639a-305a-418b-9ea8-dc1b3bfc8e8a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:05.259719 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b122639a-305a-418b-9ea8-dc1b3bfc8e8a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:05.265506 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b122639a-305a-418b-9ea8-dc1b3bfc8e8a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:05.265952 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b122639a-305a-418b-9ea8-dc1b3bfc8e8a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:05.266737 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b122639a-305a-418b-9ea8-dc1b3bfc8e8a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:05.267150 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b122639a-305a-418b-9ea8-dc1b3bfc8e8a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:05.325891 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b122639a-305a-418b-9ea8-dc1b3bfc8e8a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:05.333082 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b122639a-305a-418b-9ea8-dc1b3bfc8e8a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1222 microversion: 2.1 time: 0.077692 Dec 20 09:34:05.333814 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 467/899] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:05 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1222 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:05.500459 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-52a5840e-eaa8-4e58-9701-68fcf3fc0fe5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:05.501072 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-52a5840e-eaa8-4e58-9701-68fcf3fc0fe5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:05.508727 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-52a5840e-eaa8-4e58-9701-68fcf3fc0fe5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:05.509119 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-52a5840e-eaa8-4e58-9701-68fcf3fc0fe5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:05.509903 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-52a5840e-eaa8-4e58-9701-68fcf3fc0fe5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:05.510340 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-52a5840e-eaa8-4e58-9701-68fcf3fc0fe5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:05.637753 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-52a5840e-eaa8-4e58-9701-68fcf3fc0fe5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:05.645358 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-52a5840e-eaa8-4e58-9701-68fcf3fc0fe5 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.148860 Dec 20 09:34:05.645932 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 433/900] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:05 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:05.665853 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-17f624c2-60c4-40a7-ad81-a8732181788c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:05.666451 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-17f624c2-60c4-40a7-ad81-a8732181788c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:05.673243 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-17f624c2-60c4-40a7-ad81-a8732181788c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:05.673688 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-17f624c2-60c4-40a7-ad81-a8732181788c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:05.674498 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-17f624c2-60c4-40a7-ad81-a8732181788c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:05.674920 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-17f624c2-60c4-40a7-ad81-a8732181788c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:05.811457 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-17f624c2-60c4-40a7-ad81-a8732181788c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:05.819092 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-17f624c2-60c4-40a7-ad81-a8732181788c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:05.820609 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-17f624c2-60c4-40a7-ad81-a8732181788c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:05.821756 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-17f624c2-60c4-40a7-ad81-a8732181788c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.159578 Dec 20 09:34:05.822316 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 468/901] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:05 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:05.846648 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f840001e-f887-4783-9096-c489e0242b27 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:05.847262 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f840001e-f887-4783-9096-c489e0242b27 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:05.853172 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f840001e-f887-4783-9096-c489e0242b27 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:05.853626 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f840001e-f887-4783-9096-c489e0242b27 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:05.854403 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f840001e-f887-4783-9096-c489e0242b27 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:05.854844 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f840001e-f887-4783-9096-c489e0242b27 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:05.978192 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a0042c3a-0b1d-46b3-a441-5e5dcefc220d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:05.978858 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a0042c3a-0b1d-46b3-a441-5e5dcefc220d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:05.985243 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a0042c3a-0b1d-46b3-a441-5e5dcefc220d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:05.985809 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a0042c3a-0b1d-46b3-a441-5e5dcefc220d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:05.986968 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a0042c3a-0b1d-46b3-a441-5e5dcefc220d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:05.987417 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a0042c3a-0b1d-46b3-a441-5e5dcefc220d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:05.990188 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f840001e-f887-4783-9096-c489e0242b27 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:05.999569 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f840001e-f887-4783-9096-c489e0242b27 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.156476 Dec 20 09:34:06.000748 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 434/902] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:05 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:06.167979 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a0042c3a-0b1d-46b3-a441-5e5dcefc220d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:06.175176 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a0042c3a-0b1d-46b3-a441-5e5dcefc220d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.200773 Dec 20 09:34:06.175790 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 469/903] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:05 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:34:06.349992 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-5b4a3bd5-a67b-4a54-b0d8-5d2624d3c327 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:06.350730 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-5b4a3bd5-a67b-4a54-b0d8-5d2624d3c327 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:06.357054 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5b4a3bd5-a67b-4a54-b0d8-5d2624d3c327 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:06.357505 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5b4a3bd5-a67b-4a54-b0d8-5d2624d3c327 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:06.358291 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5b4a3bd5-a67b-4a54-b0d8-5d2624d3c327 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:06.358726 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5b4a3bd5-a67b-4a54-b0d8-5d2624d3c327 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:06.417316 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-5b4a3bd5-a67b-4a54-b0d8-5d2624d3c327 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:06.425229 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-5b4a3bd5-a67b-4a54-b0d8-5d2624d3c327 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1222 microversion: 2.1 time: 0.078908 Dec 20 09:34:06.425796 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 435/904] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:06 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:06.661272 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d9fc1af5-fa95-4d0f-b8e5-bffd3280d007 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:06.661881 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d9fc1af5-fa95-4d0f-b8e5-bffd3280d007 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:06.668004 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d9fc1af5-fa95-4d0f-b8e5-bffd3280d007 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:06.668449 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d9fc1af5-fa95-4d0f-b8e5-bffd3280d007 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:06.669760 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d9fc1af5-fa95-4d0f-b8e5-bffd3280d007 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:06.670189 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d9fc1af5-fa95-4d0f-b8e5-bffd3280d007 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:06.802314 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d9fc1af5-fa95-4d0f-b8e5-bffd3280d007 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:06.809501 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d9fc1af5-fa95-4d0f-b8e5-bffd3280d007 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.151941 Dec 20 09:34:06.810058 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 470/905] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:06 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:06.840293 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-33031d15-c7be-4e1e-ab88-ecec6f125db7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:06.841467 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-33031d15-c7be-4e1e-ab88-ecec6f125db7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:06.847817 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-33031d15-c7be-4e1e-ab88-ecec6f125db7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:06.848270 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-33031d15-c7be-4e1e-ab88-ecec6f125db7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:06.849053 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-33031d15-c7be-4e1e-ab88-ecec6f125db7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:06.849487 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-33031d15-c7be-4e1e-ab88-ecec6f125db7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:06.974039 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-33031d15-c7be-4e1e-ab88-ecec6f125db7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:06.982524 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-33031d15-c7be-4e1e-ab88-ecec6f125db7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:06.984121 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-33031d15-c7be-4e1e-ab88-ecec6f125db7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:06.985276 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-33031d15-c7be-4e1e-ab88-ecec6f125db7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.148684 Dec 20 09:34:06.985842 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 436/906] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:06 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:07.016337 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-2392e552-4645-43a3-8311-fc129c792687 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:07.016981 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-2392e552-4645-43a3-8311-fc129c792687 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:07.022875 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2392e552-4645-43a3-8311-fc129c792687 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:07.023325 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2392e552-4645-43a3-8311-fc129c792687 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:07.024143 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2392e552-4645-43a3-8311-fc129c792687 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:07.024577 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2392e552-4645-43a3-8311-fc129c792687 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:07.152214 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-2392e552-4645-43a3-8311-fc129c792687 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:07.159392 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-2392e552-4645-43a3-8311-fc129c792687 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.146731 Dec 20 09:34:07.159989 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 471/907] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:07 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:07.191241 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ddb8a1d0-5011-492f-b777-594bd99a3fd8 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:07.191959 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ddb8a1d0-5011-492f-b777-594bd99a3fd8 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:07.197658 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ddb8a1d0-5011-492f-b777-594bd99a3fd8 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:07.198108 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ddb8a1d0-5011-492f-b777-594bd99a3fd8 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:07.198878 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ddb8a1d0-5011-492f-b777-594bd99a3fd8 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:07.199308 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ddb8a1d0-5011-492f-b777-594bd99a3fd8 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:07.324668 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ddb8a1d0-5011-492f-b777-594bd99a3fd8 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:07.331881 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ddb8a1d0-5011-492f-b777-594bd99a3fd8 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.144254 Dec 20 09:34:07.334515 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 437/908] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:07 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:07.442720 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f7417ab0-5005-4e1d-9206-4401820da877 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:07.443302 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f7417ab0-5005-4e1d-9206-4401820da877 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:07.449295 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f7417ab0-5005-4e1d-9206-4401820da877 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:07.449735 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f7417ab0-5005-4e1d-9206-4401820da877 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:07.450502 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f7417ab0-5005-4e1d-9206-4401820da877 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:07.450928 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f7417ab0-5005-4e1d-9206-4401820da877 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:07.508544 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f7417ab0-5005-4e1d-9206-4401820da877 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:07.515625 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f7417ab0-5005-4e1d-9206-4401820da877 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1222 microversion: 2.1 time: 0.076692 Dec 20 09:34:07.516234 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 472/909] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:07 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1222 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:07.824893 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d25383d7-cd08-4bc9-96a8-4319674a0add tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:07.826011 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d25383d7-cd08-4bc9-96a8-4319674a0add tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:07.831913 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d25383d7-cd08-4bc9-96a8-4319674a0add tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:07.832366 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d25383d7-cd08-4bc9-96a8-4319674a0add tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:07.833146 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d25383d7-cd08-4bc9-96a8-4319674a0add tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:07.833579 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d25383d7-cd08-4bc9-96a8-4319674a0add tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:07.999260 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d25383d7-cd08-4bc9-96a8-4319674a0add tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:08.002880 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f95171c4-14fd-406e-83eb-35419c809095 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:08.003363 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f95171c4-14fd-406e-83eb-35419c809095 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:08.008397 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d25383d7-cd08-4bc9-96a8-4319674a0add tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.187066 Dec 20 09:34:08.009295 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f95171c4-14fd-406e-83eb-35419c809095 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:08.009878 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f95171c4-14fd-406e-83eb-35419c809095 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:08.011029 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f95171c4-14fd-406e-83eb-35419c809095 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:08.011148 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f95171c4-14fd-406e-83eb-35419c809095 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:08.018484 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 438/910] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:07 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:08.146276 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f95171c4-14fd-406e-83eb-35419c809095 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:08.154638 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f95171c4-14fd-406e-83eb-35419c809095 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:08.156134 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f95171c4-14fd-406e-83eb-35419c809095 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:08.157287 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f95171c4-14fd-406e-83eb-35419c809095 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.158478 Dec 20 09:34:08.157843 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 473/911] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:07 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:34:08.176144 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0d3527f2-1042-46a9-b59c-1aae41f99188 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:08.176797 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0d3527f2-1042-46a9-b59c-1aae41f99188 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:08.184800 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0d3527f2-1042-46a9-b59c-1aae41f99188 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:08.185381 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0d3527f2-1042-46a9-b59c-1aae41f99188 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:08.186453 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0d3527f2-1042-46a9-b59c-1aae41f99188 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:08.187061 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0d3527f2-1042-46a9-b59c-1aae41f99188 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:08.350439 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-57146a6d-d6f3-44a3-a441-c2d58126ac2f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:08.351502 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-57146a6d-d6f3-44a3-a441-c2d58126ac2f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:08.353283 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-0d3527f2-1042-46a9-b59c-1aae41f99188 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:08.359592 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-57146a6d-d6f3-44a3-a441-c2d58126ac2f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:08.360592 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-57146a6d-d6f3-44a3-a441-c2d58126ac2f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:08.360812 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0d3527f2-1042-46a9-b59c-1aae41f99188 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.188290 Dec 20 09:34:08.361267 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 439/912] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:08 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:08.361978 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-57146a6d-d6f3-44a3-a441-c2d58126ac2f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:08.362453 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-57146a6d-d6f3-44a3-a441-c2d58126ac2f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:08.516985 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-57146a6d-d6f3-44a3-a441-c2d58126ac2f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:08.524645 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-57146a6d-d6f3-44a3-a441-c2d58126ac2f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.179697 Dec 20 09:34:08.525244 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 474/913] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:08 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:34:08.539092 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0e998374-cb94-4470-9cf4-0c33cdbc67d4 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:08.539741 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0e998374-cb94-4470-9cf4-0c33cdbc67d4 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:08.560443 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0e998374-cb94-4470-9cf4-0c33cdbc67d4 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:08.560883 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0e998374-cb94-4470-9cf4-0c33cdbc67d4 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:08.561740 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0e998374-cb94-4470-9cf4-0c33cdbc67d4 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:08.562169 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0e998374-cb94-4470-9cf4-0c33cdbc67d4 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:08.631716 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-0e998374-cb94-4470-9cf4-0c33cdbc67d4 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:08.639309 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0e998374-cb94-4470-9cf4-0c33cdbc67d4 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1270 microversion: 2.1 time: 0.104070 Dec 20 09:34:08.640160 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 440/914] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:08 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1270 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:08.897490 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-aa7f7fcc-97e3-4cd4-a883-b3a0b16c3434 req-6fd9fac8-3cac-45c7-bef6-1e0abc465005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8", "tag": "ca7f5f87-9783-4751-ad57-587b490d4b2d"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:08.899087 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:34:08.899087 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:34:08.906145 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-aa7f7fcc-97e3-4cd4-a883-b3a0b16c3434 req-6fd9fac8-3cac-45c7-bef6-1e0abc465005 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:08.906734 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-aa7f7fcc-97e3-4cd4-a883-b3a0b16c3434 req-6fd9fac8-3cac-45c7-bef6-1e0abc465005 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:08.924884 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-aa7f7fcc-97e3-4cd4-a883-b3a0b16c3434 req-6fd9fac8-3cac-45c7-bef6-1e0abc465005 service nova] Creating event network-changed:ca7f5f87-9783-4751-ad57-587b490d4b2d for instance 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 on hv-cinder-81908 Dec 20 09:34:08.930202 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-aa7f7fcc-97e3-4cd4-a883-b3a0b16c3434 req-6fd9fac8-3cac-45c7-bef6-1e0abc465005 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036156 Dec 20 09:34:08.931344 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 475/915] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:34:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:34:09.025497 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1e7a80f1-6b48-41f7-90ec-3a719dab5877 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:09.026113 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1e7a80f1-6b48-41f7-90ec-3a719dab5877 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:09.032315 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1e7a80f1-6b48-41f7-90ec-3a719dab5877 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:09.032697 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1e7a80f1-6b48-41f7-90ec-3a719dab5877 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:09.033480 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1e7a80f1-6b48-41f7-90ec-3a719dab5877 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:09.034100 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1e7a80f1-6b48-41f7-90ec-3a719dab5877 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:09.186985 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-2a74e9ce-a022-47fd-bdab-fd94975f8399 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:09.188070 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-2a74e9ce-a022-47fd-bdab-fd94975f8399 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:09.196636 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2a74e9ce-a022-47fd-bdab-fd94975f8399 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:09.196636 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2a74e9ce-a022-47fd-bdab-fd94975f8399 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:09.196636 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2a74e9ce-a022-47fd-bdab-fd94975f8399 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:09.196636 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2a74e9ce-a022-47fd-bdab-fd94975f8399 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:09.227185 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1e7a80f1-6b48-41f7-90ec-3a719dab5877 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:09.234925 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1e7a80f1-6b48-41f7-90ec-3a719dab5877 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1513 microversion: 2.1 time: 0.213284 Dec 20 09:34:09.235510 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 441/916] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:09 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1513 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:09.445300 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-2a74e9ce-a022-47fd-bdab-fd94975f8399 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:09.458062 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-2a74e9ce-a022-47fd-bdab-fd94975f8399 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:09.459493 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-2a74e9ce-a022-47fd-bdab-fd94975f8399 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:09.461374 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-2a74e9ce-a022-47fd-bdab-fd94975f8399 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1744 microversion: 2.20 time: 0.288558 Dec 20 09:34:09.462463 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 476/917] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:09 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1744 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:09.478015 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3cb519a7-1475-4c47-91bb-828c35d2f41f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:09.479192 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-3cb519a7-1475-4c47-91bb-828c35d2f41f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:09.487543 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3cb519a7-1475-4c47-91bb-828c35d2f41f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:09.488293 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3cb519a7-1475-4c47-91bb-828c35d2f41f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:09.489318 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3cb519a7-1475-4c47-91bb-828c35d2f41f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:09.489966 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3cb519a7-1475-4c47-91bb-828c35d2f41f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:09.639532 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-a7e88443-41f2-4918-afe3-799f4f5a6594 req-91236552-29d2-4729-9cfe-4bdc8c62fec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ad12943-79b4-4049-98a9-0a88b6cb199d", "name": "network-vif-deleted", "tag": "91f40bfa-c185-4389-a36a-95ea7e7071de"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:09.641737 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:34:09.641737 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:34:09.650775 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-a7e88443-41f2-4918-afe3-799f4f5a6594 req-91236552-29d2-4729-9cfe-4bdc8c62fec4 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:09.651703 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-a7e88443-41f2-4918-afe3-799f4f5a6594 req-91236552-29d2-4729-9cfe-4bdc8c62fec4 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:09.664809 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-a7e88443-41f2-4918-afe3-799f4f5a6594 req-91236552-29d2-4729-9cfe-4bdc8c62fec4 service nova] Creating event network-vif-deleted:91f40bfa-c185-4389-a36a-95ea7e7071de for instance 4ad12943-79b4-4049-98a9-0a88b6cb199d on hv-cinder-81908 Dec 20 09:34:09.671046 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-a7e88443-41f2-4918-afe3-799f4f5a6594 req-91236552-29d2-4729-9cfe-4bdc8c62fec4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.338318 Dec 20 09:34:09.671951 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 442/918] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:34:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:34:09.678623 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f0ccb427-3c16-4986-b311-d6e80bfbde5b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:09.679875 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f0ccb427-3c16-4986-b311-d6e80bfbde5b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:09.686448 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f0ccb427-3c16-4986-b311-d6e80bfbde5b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:09.687092 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f0ccb427-3c16-4986-b311-d6e80bfbde5b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:09.688146 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f0ccb427-3c16-4986-b311-d6e80bfbde5b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:09.688874 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f0ccb427-3c16-4986-b311-d6e80bfbde5b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:09.696456 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3cb519a7-1475-4c47-91bb-828c35d2f41f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:09.704889 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3cb519a7-1475-4c47-91bb-828c35d2f41f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.230558 Dec 20 09:34:09.705123 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 477/919] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:09 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:09.709874 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c8f184d7-01c7-4636-b227-b1bc6aa1a590 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:09.710663 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c8f184d7-01c7-4636-b227-b1bc6aa1a590 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:09.717057 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c8f184d7-01c7-4636-b227-b1bc6aa1a590 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:09.717714 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c8f184d7-01c7-4636-b227-b1bc6aa1a590 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:09.720126 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c8f184d7-01c7-4636-b227-b1bc6aa1a590 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:09.720126 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c8f184d7-01c7-4636-b227-b1bc6aa1a590 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:09.794735 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-c8f184d7-01c7-4636-b227-b1bc6aa1a590 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:09.802957 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c8f184d7-01c7-4636-b227-b1bc6aa1a590 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1276 microversion: 2.1 time: 0.096611 Dec 20 09:34:09.803771 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 478/920] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:09 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1276 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:09.861346 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f0ccb427-3c16-4986-b311-d6e80bfbde5b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:09.869054 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f0ccb427-3c16-4986-b311-d6e80bfbde5b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.196073 Dec 20 09:34:09.869622 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 443/921] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:09 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:10.253105 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7f39ce6f-3eff-40d4-bafd-bcf021068dfa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:10.254015 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7f39ce6f-3eff-40d4-bafd-bcf021068dfa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:10.260614 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7f39ce6f-3eff-40d4-bafd-bcf021068dfa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:10.261139 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7f39ce6f-3eff-40d4-bafd-bcf021068dfa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:10.261943 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7f39ce6f-3eff-40d4-bafd-bcf021068dfa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:10.262381 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7f39ce6f-3eff-40d4-bafd-bcf021068dfa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:10.293447 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7f39ce6f-3eff-40d4-bafd-bcf021068dfa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:10.294553 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7f39ce6f-3eff-40d4-bafd-bcf021068dfa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:10.295002 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.objects.instance [None req-7f39ce6f-3eff-40d4-bafd-bcf021068dfa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lazy-loading 'fault' on Instance uuid 4ad12943-79b4-4049-98a9-0a88b6cb199d {{(pid=116674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:34:10.333102 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7f39ce6f-3eff-40d4-bafd-bcf021068dfa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:10.340424 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7f39ce6f-3eff-40d4-bafd-bcf021068dfa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 200 len: 1307 microversion: 2.1 time: 0.091148 Dec 20 09:34:10.341069 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 479/922] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:10 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:10.479829 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1261dd08-6e79-49e9-84fd-03cf8d34b96b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:10.480555 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1261dd08-6e79-49e9-84fd-03cf8d34b96b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:10.487028 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1261dd08-6e79-49e9-84fd-03cf8d34b96b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:10.487546 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1261dd08-6e79-49e9-84fd-03cf8d34b96b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:10.488646 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1261dd08-6e79-49e9-84fd-03cf8d34b96b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:10.489083 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1261dd08-6e79-49e9-84fd-03cf8d34b96b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:10.625185 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1261dd08-6e79-49e9-84fd-03cf8d34b96b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:10.633158 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1261dd08-6e79-49e9-84fd-03cf8d34b96b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:10.634650 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1261dd08-6e79-49e9-84fd-03cf8d34b96b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:10.635859 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1261dd08-6e79-49e9-84fd-03cf8d34b96b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1739 microversion: 2.20 time: 0.159917 Dec 20 09:34:10.649173 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 444/923] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:10 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:10.721133 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-cdf1072e-829b-4a1f-8251-f711dcef675f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:10.721910 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-cdf1072e-829b-4a1f-8251-f711dcef675f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:10.729531 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cdf1072e-829b-4a1f-8251-f711dcef675f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:10.729979 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cdf1072e-829b-4a1f-8251-f711dcef675f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:10.730762 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cdf1072e-829b-4a1f-8251-f711dcef675f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:10.731226 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cdf1072e-829b-4a1f-8251-f711dcef675f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:10.819923 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-533cf3a0-0c37-4acd-9246-39049dfc19ab tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:10.820546 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-533cf3a0-0c37-4acd-9246-39049dfc19ab tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:10.828082 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-533cf3a0-0c37-4acd-9246-39049dfc19ab tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:10.829010 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-533cf3a0-0c37-4acd-9246-39049dfc19ab tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:10.829803 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-533cf3a0-0c37-4acd-9246-39049dfc19ab tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:10.830453 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-533cf3a0-0c37-4acd-9246-39049dfc19ab tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:11.125558 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-cdf1072e-829b-4a1f-8251-f711dcef675f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:11.134709 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-cdf1072e-829b-4a1f-8251-f711dcef675f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.417162 Dec 20 09:34:11.136260 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 480/924] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:10 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:11.145458 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-491acde5-57da-498d-b290-5a8e1ded0c05 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:11.146255 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-491acde5-57da-498d-b290-5a8e1ded0c05 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:11.153830 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-491acde5-57da-498d-b290-5a8e1ded0c05 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:11.154536 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-491acde5-57da-498d-b290-5a8e1ded0c05 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:11.155325 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-491acde5-57da-498d-b290-5a8e1ded0c05 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:11.155999 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-491acde5-57da-498d-b290-5a8e1ded0c05 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:11.243535 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-533cf3a0-0c37-4acd-9246-39049dfc19ab tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:11.254148 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-533cf3a0-0c37-4acd-9246-39049dfc19ab tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1318 microversion: 2.1 time: 0.437900 Dec 20 09:34:11.259965 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 445/925] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:10 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1318 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:11.343303 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-491acde5-57da-498d-b290-5a8e1ded0c05 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:11.351350 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-491acde5-57da-498d-b290-5a8e1ded0c05 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.213774 Dec 20 09:34:11.357704 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c49098b9-32cf-4bd9-9cf0-83f4f904de1e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:11.361959 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 481/926] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:11 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:11.365719 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c49098b9-32cf-4bd9-9cf0-83f4f904de1e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 4ad12943-79b4-4049-98a9-0a88b6cb199d] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:11.373217 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c49098b9-32cf-4bd9-9cf0-83f4f904de1e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:11.374182 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c49098b9-32cf-4bd9-9cf0-83f4f904de1e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:11.375129 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c49098b9-32cf-4bd9-9cf0-83f4f904de1e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:11.375560 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c49098b9-32cf-4bd9-9cf0-83f4f904de1e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:11.396318 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-c49098b9-32cf-4bd9-9cf0-83f4f904de1e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] HTTP exception thrown: Instance 4ad12943-79b4-4049-98a9-0a88b6cb199d could not be found. Dec 20 09:34:11.397438 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c49098b9-32cf-4bd9-9cf0-83f4f904de1e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Returning 404 to user: Instance 4ad12943-79b4-4049-98a9-0a88b6cb199d could not be found. {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:34:11.402390 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c49098b9-32cf-4bd9-9cf0-83f4f904de1e tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d" status: 404 len: 111 microversion: 2.1 time: 0.048676 Dec 20 09:34:11.405680 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 446/927] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:11 2021] GET /compute/v2.1/servers/4ad12943-79b4-4049-98a9-0a88b6cb199d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 20 09:34:11.426483 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-cadbea67-dad0-4b4c-85f2-484afe60f508 req-18faeff1-0c86-421c-8c78-4d90ce66b802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10894e50-9f92-4712-9add-ca91cb29ae5f", "tag": "8fad1190-c366-409d-b720-5d2dffe5cc81"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:11.435265 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:34:11.435265 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:34:11.451480 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-cadbea67-dad0-4b4c-85f2-484afe60f508 req-18faeff1-0c86-421c-8c78-4d90ce66b802 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:11.460563 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-cadbea67-dad0-4b4c-85f2-484afe60f508 req-18faeff1-0c86-421c-8c78-4d90ce66b802 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:11.481252 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-cadbea67-dad0-4b4c-85f2-484afe60f508 req-18faeff1-0c86-421c-8c78-4d90ce66b802 service nova] Creating event network-changed:8fad1190-c366-409d-b720-5d2dffe5cc81 for instance 10894e50-9f92-4712-9add-ca91cb29ae5f on hv-cinder-81908 Dec 20 09:34:11.487309 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-cadbea67-dad0-4b4c-85f2-484afe60f508 req-18faeff1-0c86-421c-8c78-4d90ce66b802 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072387 Dec 20 09:34:11.488141 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 482/928] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:34:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:34:11.662529 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ec1d09d5-fc92-4e54-92f9-e9b72f5ed675 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:11.663327 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ec1d09d5-fc92-4e54-92f9-e9b72f5ed675 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:11.671177 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ec1d09d5-fc92-4e54-92f9-e9b72f5ed675 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:11.671752 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ec1d09d5-fc92-4e54-92f9-e9b72f5ed675 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:11.676775 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ec1d09d5-fc92-4e54-92f9-e9b72f5ed675 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:11.676775 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ec1d09d5-fc92-4e54-92f9-e9b72f5ed675 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:11.862401 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ec1d09d5-fc92-4e54-92f9-e9b72f5ed675 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:11.871473 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ec1d09d5-fc92-4e54-92f9-e9b72f5ed675 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:11.873368 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ec1d09d5-fc92-4e54-92f9-e9b72f5ed675 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:11.874540 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ec1d09d5-fc92-4e54-92f9-e9b72f5ed675 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1739 microversion: 2.20 time: 0.222405 Dec 20 09:34:11.875425 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 447/929] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:11 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:12.152635 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ed59f8b2-3345-4cc3-ac53-74ab093c73e1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:12.154352 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ed59f8b2-3345-4cc3-ac53-74ab093c73e1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:12.162957 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ed59f8b2-3345-4cc3-ac53-74ab093c73e1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:12.164011 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ed59f8b2-3345-4cc3-ac53-74ab093c73e1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:12.164996 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ed59f8b2-3345-4cc3-ac53-74ab093c73e1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:12.165827 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ed59f8b2-3345-4cc3-ac53-74ab093c73e1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:12.270611 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-65b17ffc-94f5-4ac9-bd7a-042f8e1b33bd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:12.271335 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-65b17ffc-94f5-4ac9-bd7a-042f8e1b33bd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:12.278645 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-65b17ffc-94f5-4ac9-bd7a-042f8e1b33bd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:12.280973 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-65b17ffc-94f5-4ac9-bd7a-042f8e1b33bd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:12.282657 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-65b17ffc-94f5-4ac9-bd7a-042f8e1b33bd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:12.284799 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-65b17ffc-94f5-4ac9-bd7a-042f8e1b33bd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:12.322345 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ed59f8b2-3345-4cc3-ac53-74ab093c73e1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:12.336663 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ed59f8b2-3345-4cc3-ac53-74ab093c73e1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.187917 Dec 20 09:34:12.337727 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 483/930] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:12 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:12.368735 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5ee2500d-770c-4839-87ad-d3e6eb2b8b2b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:12.369459 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-5ee2500d-770c-4839-87ad-d3e6eb2b8b2b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:12.375988 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5ee2500d-770c-4839-87ad-d3e6eb2b8b2b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:12.376730 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5ee2500d-770c-4839-87ad-d3e6eb2b8b2b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:12.378370 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5ee2500d-770c-4839-87ad-d3e6eb2b8b2b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:12.378956 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5ee2500d-770c-4839-87ad-d3e6eb2b8b2b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:12.505648 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-65b17ffc-94f5-4ac9-bd7a-042f8e1b33bd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:12.522670 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-65b17ffc-94f5-4ac9-bd7a-042f8e1b33bd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1318 microversion: 2.1 time: 0.256156 Dec 20 09:34:12.524048 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 448/931] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:12 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:12.568648 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-5ee2500d-770c-4839-87ad-d3e6eb2b8b2b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:12.580173 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-5ee2500d-770c-4839-87ad-d3e6eb2b8b2b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.215218 Dec 20 09:34:12.580852 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 484/932] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:12 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:12.742876 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e474feb4-9110-4ffc-9aa9-0b8a812989b8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:12.743404 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e474feb4-9110-4ffc-9aa9-0b8a812989b8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:12.750877 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e474feb4-9110-4ffc-9aa9-0b8a812989b8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:12.751023 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e474feb4-9110-4ffc-9aa9-0b8a812989b8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:12.751701 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e474feb4-9110-4ffc-9aa9-0b8a812989b8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:12.752142 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e474feb4-9110-4ffc-9aa9-0b8a812989b8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:12.778966 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e474feb4-9110-4ffc-9aa9-0b8a812989b8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Going to try to terminate instance {{(pid=116675) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 09:34:12.893526 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5b2af929-b942-4b57-b300-4527eb26640d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:12.894317 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-5b2af929-b942-4b57-b300-4527eb26640d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:12.900498 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5b2af929-b942-4b57-b300-4527eb26640d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:12.900950 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5b2af929-b942-4b57-b300-4527eb26640d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:12.901734 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5b2af929-b942-4b57-b300-4527eb26640d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:12.902165 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5b2af929-b942-4b57-b300-4527eb26640d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:13.056547 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-5b2af929-b942-4b57-b300-4527eb26640d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:13.065983 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-5b2af929-b942-4b57-b300-4527eb26640d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:13.067481 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-5b2af929-b942-4b57-b300-4527eb26640d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:13.068667 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-5b2af929-b942-4b57-b300-4527eb26640d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1739 microversion: 2.20 time: 0.179018 Dec 20 09:34:13.069810 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 485/933] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:12 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:13.075361 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e474feb4-9110-4ffc-9aa9-0b8a812989b8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 204 len: 0 microversion: 2.1 time: 0.335733 Dec 20 09:34:13.076230 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 449/934] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 20 09:34:12 2021] DELETE /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 09:34:13.087035 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8f7706ba-0044-4cf4-820f-df142d5cbfd4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:13.087643 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-8f7706ba-0044-4cf4-820f-df142d5cbfd4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:13.094184 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8f7706ba-0044-4cf4-820f-df142d5cbfd4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:13.094776 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8f7706ba-0044-4cf4-820f-df142d5cbfd4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:13.095414 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8f7706ba-0044-4cf4-820f-df142d5cbfd4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:13.095955 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8f7706ba-0044-4cf4-820f-df142d5cbfd4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:13.490355 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4d28f1f7-17fd-494a-b548-6e4d77d5d145 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:13.490355 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4d28f1f7-17fd-494a-b548-6e4d77d5d145 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:13.490355 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4d28f1f7-17fd-494a-b548-6e4d77d5d145 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:13.490355 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4d28f1f7-17fd-494a-b548-6e4d77d5d145 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:13.490749 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4d28f1f7-17fd-494a-b548-6e4d77d5d145 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:13.490749 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4d28f1f7-17fd-494a-b548-6e4d77d5d145 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:13.490915 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-8f7706ba-0044-4cf4-820f-df142d5cbfd4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:13.490915 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8f7706ba-0044-4cf4-820f-df142d5cbfd4 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1515 microversion: 2.1 time: 0.345687 Dec 20 09:34:13.490915 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 486/935] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:13 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1515 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:13.541910 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9ceb2d77-2370-41e0-8a06-aac5114a6e65 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:13.542651 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9ceb2d77-2370-41e0-8a06-aac5114a6e65 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:13.553103 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9ceb2d77-2370-41e0-8a06-aac5114a6e65 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:13.553557 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9ceb2d77-2370-41e0-8a06-aac5114a6e65 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:13.555007 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9ceb2d77-2370-41e0-8a06-aac5114a6e65 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:13.555439 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9ceb2d77-2370-41e0-8a06-aac5114a6e65 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:13.588629 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-4d28f1f7-17fd-494a-b548-6e4d77d5d145 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:13.613225 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4d28f1f7-17fd-494a-b548-6e4d77d5d145 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.237135 Dec 20 09:34:13.623386 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 450/936] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:13 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:13.628321 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-eff4ec29-7e23-4d48-aa68-e9995d60a492 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:13.629020 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-eff4ec29-7e23-4d48-aa68-e9995d60a492 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:13.636205 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eff4ec29-7e23-4d48-aa68-e9995d60a492 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:13.636489 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eff4ec29-7e23-4d48-aa68-e9995d60a492 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:13.637971 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eff4ec29-7e23-4d48-aa68-e9995d60a492 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:13.638373 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eff4ec29-7e23-4d48-aa68-e9995d60a492 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:13.773106 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-9ceb2d77-2370-41e0-8a06-aac5114a6e65 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:13.787763 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9ceb2d77-2370-41e0-8a06-aac5114a6e65 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1318 microversion: 2.1 time: 0.250714 Dec 20 09:34:13.788751 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 487/937] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:13 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:34:13.841745 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-eff4ec29-7e23-4d48-aa68-e9995d60a492 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:13.849948 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-eff4ec29-7e23-4d48-aa68-e9995d60a492 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.225279 Dec 20 09:34:13.850818 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 451/938] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:13 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:14.113499 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c5e3caed-3433-4152-9f94-de7804815ca7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:14.113499 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c5e3caed-3433-4152-9f94-de7804815ca7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:14.113499 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c5e3caed-3433-4152-9f94-de7804815ca7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:14.113499 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c5e3caed-3433-4152-9f94-de7804815ca7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:14.114615 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c5e3caed-3433-4152-9f94-de7804815ca7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:14.114615 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c5e3caed-3433-4152-9f94-de7804815ca7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:14.333130 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-c5e3caed-3433-4152-9f94-de7804815ca7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:14.342332 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-c5e3caed-3433-4152-9f94-de7804815ca7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:14.345157 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-c5e3caed-3433-4152-9f94-de7804815ca7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:14.346681 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c5e3caed-3433-4152-9f94-de7804815ca7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1739 microversion: 2.20 time: 0.248721 Dec 20 09:34:14.351568 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 488/939] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:14 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:14.446807 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f2a3b231-0e78-4fbf-bc0b-74da9b3e71fa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:14.448088 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f2a3b231-0e78-4fbf-bc0b-74da9b3e71fa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:14.454744 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f2a3b231-0e78-4fbf-bc0b-74da9b3e71fa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:14.455480 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f2a3b231-0e78-4fbf-bc0b-74da9b3e71fa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:14.456332 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f2a3b231-0e78-4fbf-bc0b-74da9b3e71fa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:14.467038 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f2a3b231-0e78-4fbf-bc0b-74da9b3e71fa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:14.595210 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f2a3b231-0e78-4fbf-bc0b-74da9b3e71fa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:14.603000 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f2a3b231-0e78-4fbf-bc0b-74da9b3e71fa tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1515 microversion: 2.1 time: 0.159755 Dec 20 09:34:14.603585 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 452/940] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:14 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:14.630803 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-fd27eac7-8baa-4876-8c5d-0a685af5535e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:14.631434 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-fd27eac7-8baa-4876-8c5d-0a685af5535e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:14.637312 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fd27eac7-8baa-4876-8c5d-0a685af5535e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:14.637765 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fd27eac7-8baa-4876-8c5d-0a685af5535e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:14.638551 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fd27eac7-8baa-4876-8c5d-0a685af5535e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:14.638992 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fd27eac7-8baa-4876-8c5d-0a685af5535e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:14.774036 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-fd27eac7-8baa-4876-8c5d-0a685af5535e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:14.781338 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-fd27eac7-8baa-4876-8c5d-0a685af5535e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.154957 Dec 20 09:34:14.781908 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 489/941] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:14 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:14.803812 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4956260e-af72-4b42-8d95-68b95ba82bf7 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:14.804420 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4956260e-af72-4b42-8d95-68b95ba82bf7 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:14.813930 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4956260e-af72-4b42-8d95-68b95ba82bf7 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:14.813930 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4956260e-af72-4b42-8d95-68b95ba82bf7 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:14.813930 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4956260e-af72-4b42-8d95-68b95ba82bf7 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:14.813930 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4956260e-af72-4b42-8d95-68b95ba82bf7 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:14.868175 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-84fc5590-634d-48e0-88d9-977360fc0740 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:14.873607 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-84fc5590-634d-48e0-88d9-977360fc0740 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:14.880095 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84fc5590-634d-48e0-88d9-977360fc0740 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:14.880772 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84fc5590-634d-48e0-88d9-977360fc0740 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:14.881754 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84fc5590-634d-48e0-88d9-977360fc0740 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:14.882365 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84fc5590-634d-48e0-88d9-977360fc0740 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:15.028189 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-4956260e-af72-4b42-8d95-68b95ba82bf7 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:15.037820 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4956260e-af72-4b42-8d95-68b95ba82bf7 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1318 microversion: 2.1 time: 0.237660 Dec 20 09:34:15.048701 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 453/942] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:14 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:15.073927 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-84fc5590-634d-48e0-88d9-977360fc0740 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:15.082408 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-84fc5590-634d-48e0-88d9-977360fc0740 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.218585 Dec 20 09:34:15.083303 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 490/943] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:14 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:15.367917 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-07054f94-2e45-481b-ba76-c3bdeee20508 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:15.368973 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-07054f94-2e45-481b-ba76-c3bdeee20508 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:15.375595 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-07054f94-2e45-481b-ba76-c3bdeee20508 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:15.376164 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-07054f94-2e45-481b-ba76-c3bdeee20508 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:15.377207 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-07054f94-2e45-481b-ba76-c3bdeee20508 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:15.377842 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-07054f94-2e45-481b-ba76-c3bdeee20508 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:15.568329 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-07054f94-2e45-481b-ba76-c3bdeee20508 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:15.580740 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-07054f94-2e45-481b-ba76-c3bdeee20508 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:15.584687 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-07054f94-2e45-481b-ba76-c3bdeee20508 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:15.586094 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-07054f94-2e45-481b-ba76-c3bdeee20508 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1739 microversion: 2.20 time: 0.221900 Dec 20 09:34:15.589401 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 454/944] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:15 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:15.622721 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5d871540-56e7-480a-8ca1-1d03d10b9fd8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:15.623376 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-5d871540-56e7-480a-8ca1-1d03d10b9fd8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:15.631158 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5d871540-56e7-480a-8ca1-1d03d10b9fd8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:15.636570 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5d871540-56e7-480a-8ca1-1d03d10b9fd8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:15.636570 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5d871540-56e7-480a-8ca1-1d03d10b9fd8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:15.636570 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5d871540-56e7-480a-8ca1-1d03d10b9fd8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:15.782149 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-5d871540-56e7-480a-8ca1-1d03d10b9fd8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:15.790053 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-5d871540-56e7-480a-8ca1-1d03d10b9fd8 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1515 microversion: 2.1 time: 0.173474 Dec 20 09:34:15.790827 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 491/945] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:15 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:15.805598 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-82403e71-155d-4a25-9209-b110f6e333ff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:15.806776 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-82403e71-155d-4a25-9209-b110f6e333ff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:15.815852 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-82403e71-155d-4a25-9209-b110f6e333ff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:15.816826 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-82403e71-155d-4a25-9209-b110f6e333ff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:15.817810 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-82403e71-155d-4a25-9209-b110f6e333ff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:15.818401 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-82403e71-155d-4a25-9209-b110f6e333ff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:15.988817 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-7a04ff53-51a8-4b8f-846a-f65b40716ac3 req-1bd37967-dc32-4639-b05c-1b5b2398e0ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f2bd5eb-b318-41f6-a143-65f3f05bd1d8", "name": "network-vif-deleted", "tag": "6899c157-c762-49a5-ae5b-ee0327084337"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:15.992900 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:34:15.992900 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:34:15.994470 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-82403e71-155d-4a25-9209-b110f6e333ff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:16.002890 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-7a04ff53-51a8-4b8f-846a-f65b40716ac3 req-1bd37967-dc32-4639-b05c-1b5b2398e0ca service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:16.005548 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-7a04ff53-51a8-4b8f-846a-f65b40716ac3 req-1bd37967-dc32-4639-b05c-1b5b2398e0ca service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:16.005715 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-82403e71-155d-4a25-9209-b110f6e333ff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.202762 Dec 20 09:34:16.005715 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 455/946] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:15 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:16.019801 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-7a04ff53-51a8-4b8f-846a-f65b40716ac3 req-1bd37967-dc32-4639-b05c-1b5b2398e0ca service nova] Creating event network-vif-deleted:6899c157-c762-49a5-ae5b-ee0327084337 for instance 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 on hv-cinder-81908 Dec 20 09:34:16.024608 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-7a04ff53-51a8-4b8f-846a-f65b40716ac3 req-1bd37967-dc32-4639-b05c-1b5b2398e0ca service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051022 Dec 20 09:34:16.029036 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 492/947] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:34:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:34:16.055021 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-49df989d-1558-4b48-a52e-967b9f3c3b9e tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:16.055675 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-49df989d-1558-4b48-a52e-967b9f3c3b9e tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:16.062770 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-49df989d-1558-4b48-a52e-967b9f3c3b9e tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:16.063224 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-49df989d-1558-4b48-a52e-967b9f3c3b9e tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:16.064066 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-49df989d-1558-4b48-a52e-967b9f3c3b9e tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:16.064679 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-49df989d-1558-4b48-a52e-967b9f3c3b9e tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:16.131865 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a1382505-090f-45cc-ae93-f20187e5f83b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:16.132659 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a1382505-090f-45cc-ae93-f20187e5f83b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:16.151096 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a1382505-090f-45cc-ae93-f20187e5f83b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:16.151556 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a1382505-090f-45cc-ae93-f20187e5f83b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:16.152595 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a1382505-090f-45cc-ae93-f20187e5f83b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:16.153168 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a1382505-090f-45cc-ae93-f20187e5f83b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:16.277293 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-49df989d-1558-4b48-a52e-967b9f3c3b9e tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:16.285774 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-49df989d-1558-4b48-a52e-967b9f3c3b9e tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1318 microversion: 2.1 time: 0.234640 Dec 20 09:34:16.286336 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 456/948] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:16 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:16.352294 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a1382505-090f-45cc-ae93-f20187e5f83b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:16.360827 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a1382505-090f-45cc-ae93-f20187e5f83b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.247914 Dec 20 09:34:16.361402 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 493/949] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:16 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:16.606206 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-331257f4-014a-4d55-8248-67e49b21c9fa tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:16.607071 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-331257f4-014a-4d55-8248-67e49b21c9fa tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:16.622963 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-331257f4-014a-4d55-8248-67e49b21c9fa tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:16.622963 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-331257f4-014a-4d55-8248-67e49b21c9fa tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:16.622963 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-331257f4-014a-4d55-8248-67e49b21c9fa tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:16.622963 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-331257f4-014a-4d55-8248-67e49b21c9fa tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:16.774831 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-331257f4-014a-4d55-8248-67e49b21c9fa tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:16.797457 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-331257f4-014a-4d55-8248-67e49b21c9fa tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:16.808577 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-94f8abe2-1692-42c6-bb0e-0652d788a0ea tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:16.809503 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-94f8abe2-1692-42c6-bb0e-0652d788a0ea tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:16.816226 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-331257f4-014a-4d55-8248-67e49b21c9fa tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:16.828867 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-94f8abe2-1692-42c6-bb0e-0652d788a0ea tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:16.828867 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-94f8abe2-1692-42c6-bb0e-0652d788a0ea tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:16.828867 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-94f8abe2-1692-42c6-bb0e-0652d788a0ea tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:16.829176 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-331257f4-014a-4d55-8248-67e49b21c9fa tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1739 microversion: 2.20 time: 0.215380 Dec 20 09:34:16.829260 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-94f8abe2-1692-42c6-bb0e-0652d788a0ea tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:16.830420 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 457/950] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:16 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1739 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:16.892864 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-94f8abe2-1692-42c6-bb0e-0652d788a0ea tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:16.893308 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-94f8abe2-1692-42c6-bb0e-0652d788a0ea tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:16.893761 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.objects.instance [None req-94f8abe2-1692-42c6-bb0e-0652d788a0ea tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lazy-loading 'fault' on Instance uuid 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 {{(pid=116674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:34:16.963553 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-94f8abe2-1692-42c6-bb0e-0652d788a0ea tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a6cc51b90e45d5a484e403dbbab488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24634d5b4d5a42479f08bfb638cdd78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:16.971104 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-94f8abe2-1692-42c6-bb0e-0652d788a0ea tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 200 len: 1308 microversion: 2.1 time: 0.166301 Dec 20 09:34:16.971766 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 494/951] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:16 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 1308 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:34:17.021387 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-71615108-a0e5-48dd-af1f-be4d6d60891f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:17.022110 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-71615108-a0e5-48dd-af1f-be4d6d60891f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:17.034542 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-71615108-a0e5-48dd-af1f-be4d6d60891f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:17.034983 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-71615108-a0e5-48dd-af1f-be4d6d60891f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:17.035800 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-71615108-a0e5-48dd-af1f-be4d6d60891f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:17.036230 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-71615108-a0e5-48dd-af1f-be4d6d60891f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:17.078369 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-a51a691b-5140-42fc-ba65-5b331325f168 req-61753c66-8f49-4015-bbcd-262127a3cc8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1243c272-99f3-4606-9eb2-a4fe7cd30de7", "name": "network-vif-plugged", "status": "completed", "tag": "1b76648a-4a62-41c9-a26e-314b3c466e02"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:17.082232 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:34:17.082232 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:34:17.094161 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-a51a691b-5140-42fc-ba65-5b331325f168 req-61753c66-8f49-4015-bbcd-262127a3cc8c service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:17.095125 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-a51a691b-5140-42fc-ba65-5b331325f168 req-61753c66-8f49-4015-bbcd-262127a3cc8c service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:17.112503 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-a51a691b-5140-42fc-ba65-5b331325f168 req-61753c66-8f49-4015-bbcd-262127a3cc8c service nova] Creating event network-vif-plugged:1b76648a-4a62-41c9-a26e-314b3c466e02 for instance 1243c272-99f3-4606-9eb2-a4fe7cd30de7 on hv-cinder-81908 Dec 20 09:34:17.118935 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-a51a691b-5140-42fc-ba65-5b331325f168 req-61753c66-8f49-4015-bbcd-262127a3cc8c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135300 Dec 20 09:34:17.120335 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 458/952] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:34:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:34:17.274510 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-71615108-a0e5-48dd-af1f-be4d6d60891f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:17.283981 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-71615108-a0e5-48dd-af1f-be4d6d60891f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.265886 Dec 20 09:34:17.292866 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 495/953] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:17 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:17.303898 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-5f30af12-1e91-4bc2-805d-0704d5c79a58 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:17.304710 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-5f30af12-1e91-4bc2-805d-0704d5c79a58 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:17.312926 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5f30af12-1e91-4bc2-805d-0704d5c79a58 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:17.316759 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5f30af12-1e91-4bc2-805d-0704d5c79a58 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:17.316759 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5f30af12-1e91-4bc2-805d-0704d5c79a58 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:17.316759 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5f30af12-1e91-4bc2-805d-0704d5c79a58 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:17.381223 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-52afde52-3e63-4764-9073-26886383ef2c tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:17.382134 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-52afde52-3e63-4764-9073-26886383ef2c tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:17.389521 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-52afde52-3e63-4764-9073-26886383ef2c tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:17.389972 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-52afde52-3e63-4764-9073-26886383ef2c tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:17.391082 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-52afde52-3e63-4764-9073-26886383ef2c tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:17.391705 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-52afde52-3e63-4764-9073-26886383ef2c tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:17.551979 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-5f30af12-1e91-4bc2-805d-0704d5c79a58 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:17.562396 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-5f30af12-1e91-4bc2-805d-0704d5c79a58 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1318 microversion: 2.1 time: 0.263697 Dec 20 09:34:17.572052 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 459/954] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:17 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:17.631107 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-52afde52-3e63-4764-9073-26886383ef2c tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:17.639142 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-52afde52-3e63-4764-9073-26886383ef2c tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.263525 Dec 20 09:34:17.639839 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 496/955] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:17 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:17.836095 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0c2b72ef-9cc2-4b28-b842-a8994bc1811f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:17.837126 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0c2b72ef-9cc2-4b28-b842-a8994bc1811f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:17.843891 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0c2b72ef-9cc2-4b28-b842-a8994bc1811f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:17.844338 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0c2b72ef-9cc2-4b28-b842-a8994bc1811f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:17.845305 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0c2b72ef-9cc2-4b28-b842-a8994bc1811f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:17.845742 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0c2b72ef-9cc2-4b28-b842-a8994bc1811f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:17.992165 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5cb0629b-cca8-470a-8e40-a1b96e697ab0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:17.994330 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-5cb0629b-cca8-470a-8e40-a1b96e697ab0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] [instance: 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:18.009856 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5cb0629b-cca8-470a-8e40-a1b96e697ab0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:18.010690 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5cb0629b-cca8-470a-8e40-a1b96e697ab0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:18.011753 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5cb0629b-cca8-470a-8e40-a1b96e697ab0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:18.012919 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5cb0629b-cca8-470a-8e40-a1b96e697ab0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:18.023576 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-0c2b72ef-9cc2-4b28-b842-a8994bc1811f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:18.029989 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.wsgi [None req-5cb0629b-cca8-470a-8e40-a1b96e697ab0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] HTTP exception thrown: Instance 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 could not be found. Dec 20 09:34:18.030978 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5cb0629b-cca8-470a-8e40-a1b96e697ab0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] Returning 404 to user: Instance 7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 could not be found. {{(pid=116674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:34:18.032091 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-5cb0629b-cca8-470a-8e40-a1b96e697ab0 tempest-AttachVolumeNegativeTest-862584308 tempest-AttachVolumeNegativeTest-862584308-project] 10.222.0.62 "GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8" status: 404 len: 111 microversion: 2.1 time: 0.045608 Dec 20 09:34:18.033217 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 497/956] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:17 2021] GET /compute/v2.1/servers/7f2bd5eb-b318-41f6-a143-65f3f05bd1d8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:34:18.042422 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-0c2b72ef-9cc2-4b28-b842-a8994bc1811f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:18.044102 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-0c2b72ef-9cc2-4b28-b842-a8994bc1811f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:18.050476 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0c2b72ef-9cc2-4b28-b842-a8994bc1811f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1739 microversion: 2.20 time: 0.217849 Dec 20 09:34:18.060816 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 460/957] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:17 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:18.300196 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-354e6436-75a8-4cd9-bb86-3775455ea071 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:18.300808 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-354e6436-75a8-4cd9-bb86-3775455ea071 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:18.306943 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-354e6436-75a8-4cd9-bb86-3775455ea071 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:18.307404 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-354e6436-75a8-4cd9-bb86-3775455ea071 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:18.308330 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-354e6436-75a8-4cd9-bb86-3775455ea071 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:18.308754 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-354e6436-75a8-4cd9-bb86-3775455ea071 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:18.455947 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-354e6436-75a8-4cd9-bb86-3775455ea071 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:18.463143 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-354e6436-75a8-4cd9-bb86-3775455ea071 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1363 microversion: 2.1 time: 0.166636 Dec 20 09:34:18.463723 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 498/958] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:18 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:18.579488 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6febd9dd-af5f-437d-a544-c97d952c6ea0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:18.580148 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6febd9dd-af5f-437d-a544-c97d952c6ea0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:18.586151 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6febd9dd-af5f-437d-a544-c97d952c6ea0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:18.590432 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6febd9dd-af5f-437d-a544-c97d952c6ea0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:18.590432 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6febd9dd-af5f-437d-a544-c97d952c6ea0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:18.590432 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6febd9dd-af5f-437d-a544-c97d952c6ea0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:18.659076 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-82b35b16-fabb-415f-996f-75ca86ff10d6 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:18.659076 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-82b35b16-fabb-415f-996f-75ca86ff10d6 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:18.661819 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-82b35b16-fabb-415f-996f-75ca86ff10d6 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:18.662270 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-82b35b16-fabb-415f-996f-75ca86ff10d6 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:18.663058 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-82b35b16-fabb-415f-996f-75ca86ff10d6 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:18.663498 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-82b35b16-fabb-415f-996f-75ca86ff10d6 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:18.754823 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6febd9dd-af5f-437d-a544-c97d952c6ea0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:18.762097 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6febd9dd-af5f-437d-a544-c97d952c6ea0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1318 microversion: 2.1 time: 0.186255 Dec 20 09:34:18.762856 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 461/959] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:18 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:18.905414 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-82b35b16-fabb-415f-996f-75ca86ff10d6 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:18.914650 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-82b35b16-fabb-415f-996f-75ca86ff10d6 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.262781 Dec 20 09:34:18.925193 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 499/960] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:18 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:19.068692 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9f81d4ab-7c35-4f4e-ba7d-3811e9cc4fd8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:19.069445 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9f81d4ab-7c35-4f4e-ba7d-3811e9cc4fd8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:19.089292 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9f81d4ab-7c35-4f4e-ba7d-3811e9cc4fd8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:19.090742 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9f81d4ab-7c35-4f4e-ba7d-3811e9cc4fd8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:19.094163 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9f81d4ab-7c35-4f4e-ba7d-3811e9cc4fd8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:19.094958 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9f81d4ab-7c35-4f4e-ba7d-3811e9cc4fd8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:19.284149 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-9f81d4ab-7c35-4f4e-ba7d-3811e9cc4fd8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:19.292327 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-9f81d4ab-7c35-4f4e-ba7d-3811e9cc4fd8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:19.295941 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-9f81d4ab-7c35-4f4e-ba7d-3811e9cc4fd8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:19.297350 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9f81d4ab-7c35-4f4e-ba7d-3811e9cc4fd8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1739 microversion: 2.20 time: 0.232742 Dec 20 09:34:19.298411 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 462/961] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:19 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:19.478959 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-78cabd0e-31c7-4c12-a6eb-4d89b545f1cb tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:19.479530 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-78cabd0e-31c7-4c12-a6eb-4d89b545f1cb tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:19.487612 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-78cabd0e-31c7-4c12-a6eb-4d89b545f1cb tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:19.488087 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-78cabd0e-31c7-4c12-a6eb-4d89b545f1cb tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:19.488874 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-78cabd0e-31c7-4c12-a6eb-4d89b545f1cb tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:19.489409 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-78cabd0e-31c7-4c12-a6eb-4d89b545f1cb tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:19.691576 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-78cabd0e-31c7-4c12-a6eb-4d89b545f1cb tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:19.702071 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-78cabd0e-31c7-4c12-a6eb-4d89b545f1cb tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1548 microversion: 2.1 time: 0.226778 Dec 20 09:34:19.703071 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 500/962] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:19 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1548 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:19.720969 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d6e84fbb-262e-425d-a202-ced2d1a3b4ec tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:19.721488 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d6e84fbb-262e-425d-a202-ced2d1a3b4ec tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:19.728085 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d6e84fbb-262e-425d-a202-ced2d1a3b4ec tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:19.728578 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d6e84fbb-262e-425d-a202-ced2d1a3b4ec tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:19.729610 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d6e84fbb-262e-425d-a202-ced2d1a3b4ec tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:19.730334 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d6e84fbb-262e-425d-a202-ced2d1a3b4ec tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:19.783209 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-abea0f53-6387-4deb-96c1-6b37cb1dee5b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:19.784149 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-abea0f53-6387-4deb-96c1-6b37cb1dee5b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:19.792839 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-abea0f53-6387-4deb-96c1-6b37cb1dee5b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:19.795072 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-abea0f53-6387-4deb-96c1-6b37cb1dee5b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:19.796393 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-abea0f53-6387-4deb-96c1-6b37cb1dee5b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:19.797116 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-abea0f53-6387-4deb-96c1-6b37cb1dee5b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:19.847122 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d6e84fbb-262e-425d-a202-ced2d1a3b4ec tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131590 Dec 20 09:34:19.847896 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 463/963] 10.222.0.62 () {58 vars in 1274 bytes} [Mon Dec 20 09:34:19 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:34:19.934283 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-cfb776f0-ab76-4c87-9e52-c6faab294d9d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:19.934942 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-cfb776f0-ab76-4c87-9e52-c6faab294d9d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:19.943062 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cfb776f0-ab76-4c87-9e52-c6faab294d9d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:19.943522 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cfb776f0-ab76-4c87-9e52-c6faab294d9d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:19.944346 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cfb776f0-ab76-4c87-9e52-c6faab294d9d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:19.944780 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cfb776f0-ab76-4c87-9e52-c6faab294d9d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:19.984808 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-abea0f53-6387-4deb-96c1-6b37cb1dee5b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:19.995650 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-abea0f53-6387-4deb-96c1-6b37cb1dee5b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1318 microversion: 2.1 time: 0.216135 Dec 20 09:34:20.005484 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 501/964] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:19 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:20.132266 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-cfb776f0-ab76-4c87-9e52-c6faab294d9d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:20.145294 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-cfb776f0-ab76-4c87-9e52-c6faab294d9d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.213335 Dec 20 09:34:20.151820 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 464/965] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:19 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:20.316272 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e23aa957-a86f-4bb2-b9b9-6ee471624ef9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:20.317052 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e23aa957-a86f-4bb2-b9b9-6ee471624ef9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:20.326566 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e23aa957-a86f-4bb2-b9b9-6ee471624ef9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:20.327167 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e23aa957-a86f-4bb2-b9b9-6ee471624ef9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:20.328113 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e23aa957-a86f-4bb2-b9b9-6ee471624ef9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:20.328645 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e23aa957-a86f-4bb2-b9b9-6ee471624ef9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:20.560635 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e23aa957-a86f-4bb2-b9b9-6ee471624ef9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:20.575211 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e23aa957-a86f-4bb2-b9b9-6ee471624ef9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:20.577963 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e23aa957-a86f-4bb2-b9b9-6ee471624ef9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:20.579159 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e23aa957-a86f-4bb2-b9b9-6ee471624ef9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1739 microversion: 2.20 time: 0.267165 Dec 20 09:34:20.583766 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 502/966] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:20 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1739 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:20.878203 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-18d470a1-e489-4df2-8af4-644e82c18579 req-4a0a45f9-9c67-4b7e-9847-52dd0e53e15e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10894e50-9f92-4712-9add-ca91cb29ae5f", "name": "network-vif-plugged", "status": "completed", "tag": "8fad1190-c366-409d-b720-5d2dffe5cc81"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:20.880788 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:34:20.880788 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:34:20.899806 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-18d470a1-e489-4df2-8af4-644e82c18579 req-4a0a45f9-9c67-4b7e-9847-52dd0e53e15e service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:20.900567 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-18d470a1-e489-4df2-8af4-644e82c18579 req-4a0a45f9-9c67-4b7e-9847-52dd0e53e15e service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:20.922431 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-18d470a1-e489-4df2-8af4-644e82c18579 req-4a0a45f9-9c67-4b7e-9847-52dd0e53e15e service nova] Creating event network-vif-plugged:8fad1190-c366-409d-b720-5d2dffe5cc81 for instance 10894e50-9f92-4712-9add-ca91cb29ae5f on hv-cinder-81908 Dec 20 09:34:20.930551 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-18d470a1-e489-4df2-8af4-644e82c18579 req-4a0a45f9-9c67-4b7e-9847-52dd0e53e15e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056695 Dec 20 09:34:20.931862 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 465/967] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:34:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:34:21.016333 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a0c70278-7538-4824-a382-85c50a35a5ce tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:21.019820 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a0c70278-7538-4824-a382-85c50a35a5ce tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:21.057566 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a0c70278-7538-4824-a382-85c50a35a5ce tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:21.058063 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a0c70278-7538-4824-a382-85c50a35a5ce tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:21.059513 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a0c70278-7538-4824-a382-85c50a35a5ce tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:21.061718 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a0c70278-7538-4824-a382-85c50a35a5ce tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:21.163744 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2752690f-59c6-4332-b51a-f62c0a140f26 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:21.164729 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2752690f-59c6-4332-b51a-f62c0a140f26 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:21.173514 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2752690f-59c6-4332-b51a-f62c0a140f26 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:21.174648 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2752690f-59c6-4332-b51a-f62c0a140f26 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:21.175695 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2752690f-59c6-4332-b51a-f62c0a140f26 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:21.188479 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2752690f-59c6-4332-b51a-f62c0a140f26 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:21.412127 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a0c70278-7538-4824-a382-85c50a35a5ce tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:21.421808 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a0c70278-7538-4824-a382-85c50a35a5ce tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1318 microversion: 2.1 time: 0.412499 Dec 20 09:34:21.439891 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 503/968] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:21 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:21.482762 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-2752690f-59c6-4332-b51a-f62c0a140f26 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:21.491074 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2752690f-59c6-4332-b51a-f62c0a140f26 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.331624 Dec 20 09:34:21.491682 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 466/969] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:21 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:21.599728 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-99b7e91d-0994-462a-8884-bcb2de73ab17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:21.601111 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-99b7e91d-0994-462a-8884-bcb2de73ab17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:21.608686 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-99b7e91d-0994-462a-8884-bcb2de73ab17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:21.609322 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-99b7e91d-0994-462a-8884-bcb2de73ab17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:21.610326 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-99b7e91d-0994-462a-8884-bcb2de73ab17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:21.610761 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-99b7e91d-0994-462a-8884-bcb2de73ab17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:21.838557 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-99b7e91d-0994-462a-8884-bcb2de73ab17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:21.849626 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-99b7e91d-0994-462a-8884-bcb2de73ab17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:21.852645 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-99b7e91d-0994-462a-8884-bcb2de73ab17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:21.852968 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-99b7e91d-0994-462a-8884-bcb2de73ab17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1739 microversion: 2.20 time: 0.258767 Dec 20 09:34:21.853944 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 504/970] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:21 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1739 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:21.998120 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f20775e6-3dfe-494f-b2c0-5442ca1b92b3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:21.999338 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f20775e6-3dfe-494f-b2c0-5442ca1b92b3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:22.009706 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f20775e6-3dfe-494f-b2c0-5442ca1b92b3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:22.010164 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f20775e6-3dfe-494f-b2c0-5442ca1b92b3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:22.011504 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f20775e6-3dfe-494f-b2c0-5442ca1b92b3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:22.012722 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f20775e6-3dfe-494f-b2c0-5442ca1b92b3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:22.012848 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-cb0366ee-f4c5-48c1-b4a7-45d048c896af req-cee23f37-26e1-4ea9-b444-c9bd134dc3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1243c272-99f3-4606-9eb2-a4fe7cd30de7", "tag": "1b76648a-4a62-41c9-a26e-314b3c466e02"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:22.014350 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:34:22.014350 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:34:22.023718 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-cb0366ee-f4c5-48c1-b4a7-45d048c896af req-cee23f37-26e1-4ea9-b444-c9bd134dc3b7 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:22.024166 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-cb0366ee-f4c5-48c1-b4a7-45d048c896af req-cee23f37-26e1-4ea9-b444-c9bd134dc3b7 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:22.047277 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-cb0366ee-f4c5-48c1-b4a7-45d048c896af req-cee23f37-26e1-4ea9-b444-c9bd134dc3b7 service nova] Creating event network-changed:1b76648a-4a62-41c9-a26e-314b3c466e02 for instance 1243c272-99f3-4606-9eb2-a4fe7cd30de7 on hv-cinder-81908 Dec 20 09:34:22.052705 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-cb0366ee-f4c5-48c1-b4a7-45d048c896af req-cee23f37-26e1-4ea9-b444-c9bd134dc3b7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043967 Dec 20 09:34:22.053633 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 505/971] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:34:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:34:22.125048 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f20775e6-3dfe-494f-b2c0-5442ca1b92b3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 14 microversion: 2.1 time: 0.130826 Dec 20 09:34:22.126397 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 467/972] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:34:21 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 09:34:22.451420 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-fee33c8b-fbbb-4850-bc2b-75a8663bfc87 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:22.452487 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-fee33c8b-fbbb-4850-bc2b-75a8663bfc87 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:22.482179 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fee33c8b-fbbb-4850-bc2b-75a8663bfc87 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:22.483370 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fee33c8b-fbbb-4850-bc2b-75a8663bfc87 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:22.487112 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fee33c8b-fbbb-4850-bc2b-75a8663bfc87 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:22.488108 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fee33c8b-fbbb-4850-bc2b-75a8663bfc87 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:22.513828 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-390a61e0-11df-4e96-af50-63f1449e1fd5 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:22.514886 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-390a61e0-11df-4e96-af50-63f1449e1fd5 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:22.534262 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-390a61e0-11df-4e96-af50-63f1449e1fd5 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:22.542603 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-390a61e0-11df-4e96-af50-63f1449e1fd5 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:22.547435 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-390a61e0-11df-4e96-af50-63f1449e1fd5 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:22.551527 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-390a61e0-11df-4e96-af50-63f1449e1fd5 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:22.809365 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-390a61e0-11df-4e96-af50-63f1449e1fd5 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:22.819946 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-fee33c8b-fbbb-4850-bc2b-75a8663bfc87 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:22.821645 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-390a61e0-11df-4e96-af50-63f1449e1fd5 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.316431 Dec 20 09:34:22.822428 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 468/973] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:22 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:22.836170 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-fee33c8b-fbbb-4850-bc2b-75a8663bfc87 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1318 microversion: 2.1 time: 0.389800 Dec 20 09:34:22.839303 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 506/974] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:22 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:22.875776 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d5a17698-6fc2-44b2-9fa9-92c5e0a20c44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:22.876008 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d5a17698-6fc2-44b2-9fa9-92c5e0a20c44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:22.882580 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d5a17698-6fc2-44b2-9fa9-92c5e0a20c44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:22.883383 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d5a17698-6fc2-44b2-9fa9-92c5e0a20c44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:22.884491 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d5a17698-6fc2-44b2-9fa9-92c5e0a20c44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:22.885584 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d5a17698-6fc2-44b2-9fa9-92c5e0a20c44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:22.953696 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-3b818f8d-d4a3-4440-b2ad-84e1cde5e435 req-9b374a86-b546-4e59-90ca-4e713a073973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8", "name": "network-vif-plugged", "status": "completed", "tag": "ca7f5f87-9783-4751-ad57-587b490d4b2d"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:22.967312 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:34:22.967312 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:34:22.968924 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-3b818f8d-d4a3-4440-b2ad-84e1cde5e435 req-9b374a86-b546-4e59-90ca-4e713a073973 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:22.970165 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-3b818f8d-d4a3-4440-b2ad-84e1cde5e435 req-9b374a86-b546-4e59-90ca-4e713a073973 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:22.986836 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-3b818f8d-d4a3-4440-b2ad-84e1cde5e435 req-9b374a86-b546-4e59-90ca-4e713a073973 service nova] Creating event network-vif-plugged:ca7f5f87-9783-4751-ad57-587b490d4b2d for instance 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 on hv-cinder-81908 Dec 20 09:34:22.992868 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-3b818f8d-d4a3-4440-b2ad-84e1cde5e435 req-9b374a86-b546-4e59-90ca-4e713a073973 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044021 Dec 20 09:34:22.994067 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 507/975] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:34:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:34:23.055776 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d5a17698-6fc2-44b2-9fa9-92c5e0a20c44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:23.064654 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d5a17698-6fc2-44b2-9fa9-92c5e0a20c44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:23.066707 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d5a17698-6fc2-44b2-9fa9-92c5e0a20c44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:23.068210 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d5a17698-6fc2-44b2-9fa9-92c5e0a20c44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1739 microversion: 2.20 time: 0.197862 Dec 20 09:34:23.068983 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 469/976] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:22 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:23.136760 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-468f450b-a62f-448e-818c-dfe4bae2ca1b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:23.137999 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-468f450b-a62f-448e-818c-dfe4bae2ca1b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:23.144039 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-468f450b-a62f-448e-818c-dfe4bae2ca1b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:23.145170 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-468f450b-a62f-448e-818c-dfe4bae2ca1b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:23.145302 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-468f450b-a62f-448e-818c-dfe4bae2ca1b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:23.145826 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-468f450b-a62f-448e-818c-dfe4bae2ca1b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:23.218143 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-468f450b-a62f-448e-818c-dfe4bae2ca1b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 14 microversion: 2.1 time: 0.085175 Dec 20 09:34:23.221467 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 508/977] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:34:23 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 09:34:23.841270 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-81332b7e-1478-4255-b4db-f3f086c83e41 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:23.842178 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-81332b7e-1478-4255-b4db-f3f086c83e41 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:23.851735 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-81332b7e-1478-4255-b4db-f3f086c83e41 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:23.852504 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-81332b7e-1478-4255-b4db-f3f086c83e41 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:23.853886 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-81332b7e-1478-4255-b4db-f3f086c83e41 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:23.854536 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-81332b7e-1478-4255-b4db-f3f086c83e41 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:23.873113 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-37ec731c-f58c-4a1c-8718-dbe0d71e82c3 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:23.874772 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-37ec731c-f58c-4a1c-8718-dbe0d71e82c3 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:23.903505 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37ec731c-f58c-4a1c-8718-dbe0d71e82c3 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:23.903983 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37ec731c-f58c-4a1c-8718-dbe0d71e82c3 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:23.910832 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37ec731c-f58c-4a1c-8718-dbe0d71e82c3 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:23.911447 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37ec731c-f58c-4a1c-8718-dbe0d71e82c3 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:24.172187 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-81332b7e-1478-4255-b4db-f3f086c83e41 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:24.195980 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-37ec731c-f58c-4a1c-8718-dbe0d71e82c3 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:24.212279 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-81332b7e-1478-4255-b4db-f3f086c83e41 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.364208 Dec 20 09:34:24.212279 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 470/978] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:23 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:24.215155 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-37ec731c-f58c-4a1c-8718-dbe0d71e82c3 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1506 microversion: 2.1 time: 0.350664 Dec 20 09:34:24.216126 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 509/979] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:23 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:24.217684 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a3f22669-8d63-45ce-b007-9424a0fdbdc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:24.224724 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a3f22669-8d63-45ce-b007-9424a0fdbdc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:24.233552 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-bfc3ee4f-f3ba-4e2f-8d77-bb072da6b122 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:24.240716 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-bfc3ee4f-f3ba-4e2f-8d77-bb072da6b122 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:24.241384 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a3f22669-8d63-45ce-b007-9424a0fdbdc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:24.241384 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a3f22669-8d63-45ce-b007-9424a0fdbdc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:24.241384 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a3f22669-8d63-45ce-b007-9424a0fdbdc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:24.241384 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a3f22669-8d63-45ce-b007-9424a0fdbdc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:24.242898 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bfc3ee4f-f3ba-4e2f-8d77-bb072da6b122 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:24.243677 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bfc3ee4f-f3ba-4e2f-8d77-bb072da6b122 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:24.245006 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bfc3ee4f-f3ba-4e2f-8d77-bb072da6b122 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:24.245507 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bfc3ee4f-f3ba-4e2f-8d77-bb072da6b122 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:24.375622 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a3f22669-8d63-45ce-b007-9424a0fdbdc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:24.378054 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-bfc3ee4f-f3ba-4e2f-8d77-bb072da6b122 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 14 microversion: 2.1 time: 0.150371 Dec 20 09:34:24.378771 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 510/980] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:34:24 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 09:34:24.384022 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8d72f2d0-2b4b-46b5-89f1-acd40cde8d26 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e2df48e-a2f7-44b6-895d-5204f1a46397", "device": "/dev/sdb"}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:24.385307 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-8d72f2d0-2b4b-46b5-89f1-acd40cde8d26 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:24.386147 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a3f22669-8d63-45ce-b007-9424a0fdbdc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:24.387652 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a3f22669-8d63-45ce-b007-9424a0fdbdc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:24.388812 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a3f22669-8d63-45ce-b007-9424a0fdbdc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1739 microversion: 2.20 time: 0.183842 Dec 20 09:34:24.389361 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 471/981] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:24 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:24.392348 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8d72f2d0-2b4b-46b5-89f1-acd40cde8d26 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:24.392785 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8d72f2d0-2b4b-46b5-89f1-acd40cde8d26 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:24.393557 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8d72f2d0-2b4b-46b5-89f1-acd40cde8d26 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:24.393985 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8d72f2d0-2b4b-46b5-89f1-acd40cde8d26 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:25.003925 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8d72f2d0-2b4b-46b5-89f1-acd40cde8d26 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "POST /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.623515 Dec 20 09:34:25.004907 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 511/982] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 20 09:34:24 2021] POST /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f/os-volume_attachments => generated 194 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:34:25.219985 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d782a764-355d-4fe3-ba65-81fbeef7a9de tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:25.220724 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d782a764-355d-4fe3-ba65-81fbeef7a9de tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:25.226485 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d782a764-355d-4fe3-ba65-81fbeef7a9de tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:25.226935 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d782a764-355d-4fe3-ba65-81fbeef7a9de tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:25.227742 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d782a764-355d-4fe3-ba65-81fbeef7a9de tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:25.228181 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d782a764-355d-4fe3-ba65-81fbeef7a9de tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:25.370832 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d782a764-355d-4fe3-ba65-81fbeef7a9de tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:25.378308 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d782a764-355d-4fe3-ba65-81fbeef7a9de tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1356 microversion: 2.1 time: 0.162077 Dec 20 09:34:25.378879 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 472/983] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:25 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:25.390394 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7e0da319-e55a-4412-9deb-2adf1a3742a7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:25.391481 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7e0da319-e55a-4412-9deb-2adf1a3742a7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:25.398185 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7e0da319-e55a-4412-9deb-2adf1a3742a7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:25.398634 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7e0da319-e55a-4412-9deb-2adf1a3742a7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:25.399410 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7e0da319-e55a-4412-9deb-2adf1a3742a7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:25.399880 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7e0da319-e55a-4412-9deb-2adf1a3742a7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:25.405986 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b02c6af4-578d-408c-a19d-fec4d70fcccc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:25.406599 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b02c6af4-578d-408c-a19d-fec4d70fcccc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:25.412701 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b02c6af4-578d-408c-a19d-fec4d70fcccc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:25.413148 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b02c6af4-578d-408c-a19d-fec4d70fcccc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:25.413928 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b02c6af4-578d-408c-a19d-fec4d70fcccc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:25.414363 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b02c6af4-578d-408c-a19d-fec4d70fcccc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:25.484443 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7e0da319-e55a-4412-9deb-2adf1a3742a7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 14 microversion: 2.1 time: 0.098849 Dec 20 09:34:25.487832 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 512/984] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:34:25 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 09:34:25.552358 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b02c6af4-578d-408c-a19d-fec4d70fcccc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:25.563880 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b02c6af4-578d-408c-a19d-fec4d70fcccc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:25.566390 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b02c6af4-578d-408c-a19d-fec4d70fcccc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:25.568500 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b02c6af4-578d-408c-a19d-fec4d70fcccc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1739 microversion: 2.20 time: 0.166083 Dec 20 09:34:25.569230 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 473/985] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:25 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:34:26.396089 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-95b4419c-af7c-4d10-bd23-453f701e0703 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:26.396819 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-95b4419c-af7c-4d10-bd23-453f701e0703 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:26.404230 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-95b4419c-af7c-4d10-bd23-453f701e0703 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:26.404683 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-95b4419c-af7c-4d10-bd23-453f701e0703 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:26.405477 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-95b4419c-af7c-4d10-bd23-453f701e0703 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:26.405911 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-95b4419c-af7c-4d10-bd23-453f701e0703 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:26.494528 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e06473b2-56db-455d-be78-eae4bfdde9c8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:26.495434 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e06473b2-56db-455d-be78-eae4bfdde9c8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:26.502862 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e06473b2-56db-455d-be78-eae4bfdde9c8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:26.503545 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e06473b2-56db-455d-be78-eae4bfdde9c8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:26.504602 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e06473b2-56db-455d-be78-eae4bfdde9c8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:26.505188 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e06473b2-56db-455d-be78-eae4bfdde9c8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:26.542572 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-95b4419c-af7c-4d10-bd23-453f701e0703 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:26.549735 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-95b4419c-af7c-4d10-bd23-453f701e0703 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1546 microversion: 2.1 time: 0.157831 Dec 20 09:34:26.550301 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 513/986] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:26 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:26.565262 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-23fdbd8d-f165-4001-a87b-40c3a96ad269 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:26.565858 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-23fdbd8d-f165-4001-a87b-40c3a96ad269 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:26.571381 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-23fdbd8d-f165-4001-a87b-40c3a96ad269 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:26.571755 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e06473b2-56db-455d-be78-eae4bfdde9c8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 14 microversion: 2.1 time: 0.080706 Dec 20 09:34:26.571891 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-23fdbd8d-f165-4001-a87b-40c3a96ad269 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:26.572687 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 474/987] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:34:26 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 20 09:34:26.572822 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-23fdbd8d-f165-4001-a87b-40c3a96ad269 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:26.573029 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-23fdbd8d-f165-4001-a87b-40c3a96ad269 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:26.586536 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-47a0e3a8-cf4a-48bc-8e04-a166e0d283fb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:26.587342 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-47a0e3a8-cf4a-48bc-8e04-a166e0d283fb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:26.594408 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-47a0e3a8-cf4a-48bc-8e04-a166e0d283fb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:26.594927 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-47a0e3a8-cf4a-48bc-8e04-a166e0d283fb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:26.595808 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-47a0e3a8-cf4a-48bc-8e04-a166e0d283fb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:26.596249 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-47a0e3a8-cf4a-48bc-8e04-a166e0d283fb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:26.775284 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-23fdbd8d-f165-4001-a87b-40c3a96ad269 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:26.784310 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-47a0e3a8-cf4a-48bc-8e04-a166e0d283fb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:26.786706 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-23fdbd8d-f165-4001-a87b-40c3a96ad269 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1546 microversion: 2.1 time: 0.224642 Dec 20 09:34:26.787277 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 514/988] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:26 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1546 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:34:26.795644 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-47a0e3a8-cf4a-48bc-8e04-a166e0d283fb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:26.797145 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-47a0e3a8-cf4a-48bc-8e04-a166e0d283fb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:26.802273 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b2134d6c-e889-4a04-b238-9491fd140597 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:26.805558 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:34:26.805558 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:34:26.806533 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b2134d6c-e889-4a04-b238-9491fd140597 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:26.807263 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b2134d6c-e889-4a04-b238-9491fd140597 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Searching by: {'deleted': False, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e'} {{(pid=116674) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 20 09:34:26.808361 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-47a0e3a8-cf4a-48bc-8e04-a166e0d283fb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1721 microversion: 2.20 time: 0.225919 Dec 20 09:34:26.808928 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 475/989] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:26 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:34:26.815092 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b2134d6c-e889-4a04-b238-9491fd140597 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:26.815537 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b2134d6c-e889-4a04-b238-9491fd140597 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:26.816390 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b2134d6c-e889-4a04-b238-9491fd140597 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:26.816949 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b2134d6c-e889-4a04-b238-9491fd140597 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:26.906323 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.multi_cell_list [None req-b2134d6c-e889-4a04-b238-9491fd140597 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116674) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 20 09:34:27.002104 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b2134d6c-e889-4a04-b238-9491fd140597 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.203141 Dec 20 09:34:27.002694 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 515/990] 10.222.0.62 () {58 vars in 1124 bytes} [Mon Dec 20 09:34:26 2021] GET /compute/v2.1/servers => generated 342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:34:27.013100 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a59d1971-755f-428e-9ebc-2c47edb757de tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:27.013699 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a59d1971-755f-428e-9ebc-2c47edb757de tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:27.019985 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a59d1971-755f-428e-9ebc-2c47edb757de tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:27.020430 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a59d1971-755f-428e-9ebc-2c47edb757de tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:27.021203 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a59d1971-755f-428e-9ebc-2c47edb757de tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:27.021638 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a59d1971-755f-428e-9ebc-2c47edb757de tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:27.151249 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a59d1971-755f-428e-9ebc-2c47edb757de tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:27.163302 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a59d1971-755f-428e-9ebc-2c47edb757de tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1546 microversion: 2.1 time: 0.154130 Dec 20 09:34:27.164511 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 476/991] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:27 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:27.583147 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-129cfe9b-4145-466f-ac21-5f83596c5dc7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:27.584060 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-129cfe9b-4145-466f-ac21-5f83596c5dc7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:27.591422 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-129cfe9b-4145-466f-ac21-5f83596c5dc7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:27.591929 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-129cfe9b-4145-466f-ac21-5f83596c5dc7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:27.592721 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-129cfe9b-4145-466f-ac21-5f83596c5dc7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:27.593161 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-129cfe9b-4145-466f-ac21-5f83596c5dc7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:27.654190 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-129cfe9b-4145-466f-ac21-5f83596c5dc7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 14 microversion: 2.1 time: 0.074574 Dec 20 09:34:27.655203 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 516/992] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:34:27 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 09:34:27.826554 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-fd6a075a-1cc9-4b26-8882-d7177872f050 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:27.827163 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-fd6a075a-1cc9-4b26-8882-d7177872f050 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:27.833385 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fd6a075a-1cc9-4b26-8882-d7177872f050 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:27.833843 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fd6a075a-1cc9-4b26-8882-d7177872f050 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:27.837056 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fd6a075a-1cc9-4b26-8882-d7177872f050 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:27.837056 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fd6a075a-1cc9-4b26-8882-d7177872f050 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:27.973157 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-fd6a075a-1cc9-4b26-8882-d7177872f050 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:27.981275 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-fd6a075a-1cc9-4b26-8882-d7177872f050 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:27.983516 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-fd6a075a-1cc9-4b26-8882-d7177872f050 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:27.984417 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-fd6a075a-1cc9-4b26-8882-d7177872f050 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1724 microversion: 2.20 time: 0.162155 Dec 20 09:34:27.997700 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 477/993] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:27 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:28.006238 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d9ea78be-e2dd-45b4-9018-f26096405146 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c92b90fa-4e49-4235-bb66-5f5f7e4758c8"}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:28.007350 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d9ea78be-e2dd-45b4-9018-f26096405146 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:28.015109 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d9ea78be-e2dd-45b4-9018-f26096405146 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:28.015557 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d9ea78be-e2dd-45b4-9018-f26096405146 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:28.016376 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d9ea78be-e2dd-45b4-9018-f26096405146 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:28.016812 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d9ea78be-e2dd-45b4-9018-f26096405146 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:28.662765 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-796efc91-6aa3-42cb-9a8c-71927814eea8 req-f1c4be3f-dea3-4e62-9d47-b22a79f3fe6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9ba0eda-fab4-44dc-b41f-0c51574dca1f", "name": "network-vif-unplugged", "status": "completed", "tag": "b868aa5a-bfbe-4a31-ac51-6ef583b78b0e"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:28.664556 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:34:28.664556 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:34:28.672926 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-796efc91-6aa3-42cb-9a8c-71927814eea8 req-f1c4be3f-dea3-4e62-9d47-b22a79f3fe6f service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:28.673397 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-796efc91-6aa3-42cb-9a8c-71927814eea8 req-f1c4be3f-dea3-4e62-9d47-b22a79f3fe6f service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:28.685052 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.compute.server_external_events [req-796efc91-6aa3-42cb-9a8c-71927814eea8 req-f1c4be3f-dea3-4e62-9d47-b22a79f3fe6f service nova] Unable to find a host for instance c9ba0eda-fab4-44dc-b41f-0c51574dca1f. Dropping event network-vif-unplugged {{(pid=116675) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 20 09:34:28.685962 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-796efc91-6aa3-42cb-9a8c-71927814eea8 req-f1c4be3f-dea3-4e62-9d47-b22a79f3fe6f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034667 Dec 20 09:34:28.686550 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 478/994] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:34:28 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Dec 20 09:34:28.694138 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-02e86101-582a-4faf-92c3-3a4e9a749d8f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:28.694138 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-02e86101-582a-4faf-92c3-3a4e9a749d8f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:28.699330 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-02e86101-582a-4faf-92c3-3a4e9a749d8f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:28.699827 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-02e86101-582a-4faf-92c3-3a4e9a749d8f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:28.700637 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-02e86101-582a-4faf-92c3-3a4e9a749d8f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:28.701290 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-02e86101-582a-4faf-92c3-3a4e9a749d8f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:28.761885 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-02e86101-582a-4faf-92c3-3a4e9a749d8f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 14 microversion: 2.1 time: 0.072912 Dec 20 09:34:28.762508 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 479/995] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:34:28 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 09:34:29.029277 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d9ea78be-e2dd-45b4-9018-f26096405146 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.029940 Dec 20 09:34:29.034494 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 517/996] 10.222.0.62 () {62 vars in 1363 bytes} [Mon Dec 20 09:34:27 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/os-volume_attachments => generated 188 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:34:29.169282 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-5d354321-3079-4941-b4bf-20fc1f7b434d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51e8cfa0-ad46-481b-8a6b-bed4f3ee0e2a"}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:29.170909 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-5d354321-3079-4941-b4bf-20fc1f7b434d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:29.184194 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5d354321-3079-4941-b4bf-20fc1f7b434d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:29.184194 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5d354321-3079-4941-b4bf-20fc1f7b434d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:29.184194 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5d354321-3079-4941-b4bf-20fc1f7b434d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:29.184194 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5d354321-3079-4941-b4bf-20fc1f7b434d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:29.198652 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4aaa4c06-5663-4387-8862-ef160ba04c00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:29.199788 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-4aaa4c06-5663-4387-8862-ef160ba04c00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:29.206637 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4aaa4c06-5663-4387-8862-ef160ba04c00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:29.207165 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4aaa4c06-5663-4387-8862-ef160ba04c00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:29.208049 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4aaa4c06-5663-4387-8862-ef160ba04c00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:29.208482 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4aaa4c06-5663-4387-8862-ef160ba04c00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:29.504134 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-4aaa4c06-5663-4387-8862-ef160ba04c00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action" status: 202 len: 0 microversion: 2.20 time: 0.309325 Dec 20 09:34:29.504941 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 518/997] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:34:29 2021] POST /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 20 09:34:29.513244 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ec3d6333-bc35-44ce-9df1-a07df93c4a68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:29.513860 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ec3d6333-bc35-44ce-9df1-a07df93c4a68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:29.526037 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ec3d6333-bc35-44ce-9df1-a07df93c4a68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:29.527025 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ec3d6333-bc35-44ce-9df1-a07df93c4a68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:29.531088 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ec3d6333-bc35-44ce-9df1-a07df93c4a68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:29.531088 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ec3d6333-bc35-44ce-9df1-a07df93c4a68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:29.678065 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ec3d6333-bc35-44ce-9df1-a07df93c4a68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:29.686635 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ec3d6333-bc35-44ce-9df1-a07df93c4a68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:29.688116 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ec3d6333-bc35-44ce-9df1-a07df93c4a68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:29.689342 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ec3d6333-bc35-44ce-9df1-a07df93c4a68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1750 microversion: 2.20 time: 0.180507 Dec 20 09:34:29.694345 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 519/998] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:29 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1750 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:34:29.772721 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-68f0b900-7a1e-440b-8f82-fcb0fac0d605 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:29.773794 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-68f0b900-7a1e-440b-8f82-fcb0fac0d605 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:29.780419 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-68f0b900-7a1e-440b-8f82-fcb0fac0d605 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:29.780943 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-68f0b900-7a1e-440b-8f82-fcb0fac0d605 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:29.781727 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-68f0b900-7a1e-440b-8f82-fcb0fac0d605 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:29.782173 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-68f0b900-7a1e-440b-8f82-fcb0fac0d605 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:29.997669 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-5d354321-3079-4941-b4bf-20fc1f7b434d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "POST /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.833051 Dec 20 09:34:29.998471 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 480/999] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 20 09:34:29 2021] POST /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8/os-volume_attachments => generated 194 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:34:30.019311 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-68f0b900-7a1e-440b-8f82-fcb0fac0d605 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 14 microversion: 2.1 time: 0.249885 Dec 20 09:34:30.019825 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 520/1000] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:34:29 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 14 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 20 09:34:30.708642 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-68312d4e-2c63-42b8-bbd0-9fde6c0533df tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:30.709336 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-68312d4e-2c63-42b8-bbd0-9fde6c0533df tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:30.716149 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-68312d4e-2c63-42b8-bbd0-9fde6c0533df tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:30.716597 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-68312d4e-2c63-42b8-bbd0-9fde6c0533df tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:30.717537 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-68312d4e-2c63-42b8-bbd0-9fde6c0533df tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:30.717974 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-68312d4e-2c63-42b8-bbd0-9fde6c0533df tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:30.891277 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-68312d4e-2c63-42b8-bbd0-9fde6c0533df tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:30.899789 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-68312d4e-2c63-42b8-bbd0-9fde6c0533df tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:30.901291 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-68312d4e-2c63-42b8-bbd0-9fde6c0533df tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:30.902450 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-68312d4e-2c63-42b8-bbd0-9fde6c0533df tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1750 microversion: 2.20 time: 0.198525 Dec 20 09:34:30.903017 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 481/1001] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:30 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1750 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:31.033909 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8f7f47e6-27ae-433b-9be3-f67f2e87fdf2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:31.033909 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-8f7f47e6-27ae-433b-9be3-f67f2e87fdf2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:31.038951 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8f7f47e6-27ae-433b-9be3-f67f2e87fdf2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:31.039410 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8f7f47e6-27ae-433b-9be3-f67f2e87fdf2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:31.040215 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8f7f47e6-27ae-433b-9be3-f67f2e87fdf2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:31.040650 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8f7f47e6-27ae-433b-9be3-f67f2e87fdf2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:31.120683 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8f7f47e6-27ae-433b-9be3-f67f2e87fdf2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 14 microversion: 2.1 time: 0.093978 Dec 20 09:34:31.122139 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 521/1002] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:34:31 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 09:34:31.921231 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ab297cd3-9ea2-46b2-9ffb-3276587c2f6c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:31.921835 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ab297cd3-9ea2-46b2-9ffb-3276587c2f6c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:31.928055 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ab297cd3-9ea2-46b2-9ffb-3276587c2f6c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:31.928702 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ab297cd3-9ea2-46b2-9ffb-3276587c2f6c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:31.929481 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ab297cd3-9ea2-46b2-9ffb-3276587c2f6c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:31.929908 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ab297cd3-9ea2-46b2-9ffb-3276587c2f6c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:32.065035 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ab297cd3-9ea2-46b2-9ffb-3276587c2f6c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:32.073239 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ab297cd3-9ea2-46b2-9ffb-3276587c2f6c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:32.074716 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ab297cd3-9ea2-46b2-9ffb-3276587c2f6c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:32.075906 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ab297cd3-9ea2-46b2-9ffb-3276587c2f6c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1752 microversion: 2.20 time: 0.159049 Dec 20 09:34:32.076535 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 482/1003] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:31 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:32.133198 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-55eaee7e-de09-41a0-bee6-63a76377bbba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:32.134481 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-55eaee7e-de09-41a0-bee6-63a76377bbba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:32.146604 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-55eaee7e-de09-41a0-bee6-63a76377bbba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:32.147139 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-55eaee7e-de09-41a0-bee6-63a76377bbba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:32.148183 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-55eaee7e-de09-41a0-bee6-63a76377bbba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:32.148622 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-55eaee7e-de09-41a0-bee6-63a76377bbba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:32.225738 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-55eaee7e-de09-41a0-bee6-63a76377bbba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 14 microversion: 2.1 time: 0.096341 Dec 20 09:34:32.229022 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 522/1004] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:34:32 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 09:34:33.093980 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-3aa97c7c-7317-479d-a77e-c2f00735a07b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:33.094872 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-3aa97c7c-7317-479d-a77e-c2f00735a07b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:33.101174 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3aa97c7c-7317-479d-a77e-c2f00735a07b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:33.101628 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3aa97c7c-7317-479d-a77e-c2f00735a07b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:33.102414 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3aa97c7c-7317-479d-a77e-c2f00735a07b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:33.102851 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3aa97c7c-7317-479d-a77e-c2f00735a07b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:33.237491 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0401e3e6-4be2-4a00-bc97-0f7cc054e041 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:33.238209 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0401e3e6-4be2-4a00-bc97-0f7cc054e041 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:33.239446 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-3aa97c7c-7317-479d-a77e-c2f00735a07b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:33.244746 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0401e3e6-4be2-4a00-bc97-0f7cc054e041 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:33.245197 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0401e3e6-4be2-4a00-bc97-0f7cc054e041 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:33.246814 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0401e3e6-4be2-4a00-bc97-0f7cc054e041 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:33.247462 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0401e3e6-4be2-4a00-bc97-0f7cc054e041 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:33.248470 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-3aa97c7c-7317-479d-a77e-c2f00735a07b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:33.249936 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-3aa97c7c-7317-479d-a77e-c2f00735a07b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:33.251116 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-3aa97c7c-7317-479d-a77e-c2f00735a07b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1752 microversion: 2.20 time: 0.160844 Dec 20 09:34:33.252539 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 483/1005] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:33 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:33.327031 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0401e3e6-4be2-4a00-bc97-0f7cc054e041 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 9366 microversion: 2.1 time: 0.093772 Dec 20 09:34:33.327684 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 523/1006] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:34:33 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 9366 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:34.269229 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-47699f01-7b05-41e9-abf4-e421cf69fa7c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:34.271149 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-47699f01-7b05-41e9-abf4-e421cf69fa7c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:34.278392 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-47699f01-7b05-41e9-abf4-e421cf69fa7c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:34.278833 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-47699f01-7b05-41e9-abf4-e421cf69fa7c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:34.279622 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-47699f01-7b05-41e9-abf4-e421cf69fa7c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:34.280087 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-47699f01-7b05-41e9-abf4-e421cf69fa7c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:34.339035 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-51ea1d97-885e-4e9e-b047-11f0d2fd783a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:34.340544 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-51ea1d97-885e-4e9e-b047-11f0d2fd783a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:34.347465 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-51ea1d97-885e-4e9e-b047-11f0d2fd783a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:34.348012 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-51ea1d97-885e-4e9e-b047-11f0d2fd783a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:34.348868 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-51ea1d97-885e-4e9e-b047-11f0d2fd783a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:34.349378 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-51ea1d97-885e-4e9e-b047-11f0d2fd783a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:34.414763 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-47699f01-7b05-41e9-abf4-e421cf69fa7c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:34.423053 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-47699f01-7b05-41e9-abf4-e421cf69fa7c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:34.424640 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-47699f01-7b05-41e9-abf4-e421cf69fa7c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:34.425782 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-47699f01-7b05-41e9-abf4-e421cf69fa7c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1752 microversion: 2.20 time: 0.161525 Dec 20 09:34:34.426980 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 484/1007] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:34 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:34.430314 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-51ea1d97-885e-4e9e-b047-11f0d2fd783a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 16280 microversion: 2.1 time: 0.095390 Dec 20 09:34:34.431018 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 524/1008] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:34:34 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 16280 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 09:34:35.441480 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e0a88608-5348-41ae-871b-14c40f44230e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:35.442462 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e0a88608-5348-41ae-871b-14c40f44230e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:35.443926 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ddaa570a-939f-420b-9558-d833ec94b4f2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:35.444620 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ddaa570a-939f-420b-9558-d833ec94b4f2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:35.448710 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e0a88608-5348-41ae-871b-14c40f44230e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:35.449168 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e0a88608-5348-41ae-871b-14c40f44230e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:35.449943 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e0a88608-5348-41ae-871b-14c40f44230e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:35.450377 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e0a88608-5348-41ae-871b-14c40f44230e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:35.451313 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ddaa570a-939f-420b-9558-d833ec94b4f2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:35.451783 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ddaa570a-939f-420b-9558-d833ec94b4f2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:35.452554 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ddaa570a-939f-420b-9558-d833ec94b4f2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:35.452986 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ddaa570a-939f-420b-9558-d833ec94b4f2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:35.579025 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ddaa570a-939f-420b-9558-d833ec94b4f2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:35.587119 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ddaa570a-939f-420b-9558-d833ec94b4f2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:35.588621 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ddaa570a-939f-420b-9558-d833ec94b4f2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:35.590277 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ddaa570a-939f-420b-9558-d833ec94b4f2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1752 microversion: 2.20 time: 0.150351 Dec 20 09:34:35.590829 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 525/1009] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:35 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:34:36.608413 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-00fe6372-e11b-4b9d-b736-22f5259085ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:36.615892 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-00fe6372-e11b-4b9d-b736-22f5259085ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:36.616193 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-00fe6372-e11b-4b9d-b736-22f5259085ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:36.616643 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-00fe6372-e11b-4b9d-b736-22f5259085ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:36.617435 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-00fe6372-e11b-4b9d-b736-22f5259085ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:36.617873 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-00fe6372-e11b-4b9d-b736-22f5259085ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:36.756733 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-00fe6372-e11b-4b9d-b736-22f5259085ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:36.761480 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-00fe6372-e11b-4b9d-b736-22f5259085ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:36.762944 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-00fe6372-e11b-4b9d-b736-22f5259085ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:36.764112 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-00fe6372-e11b-4b9d-b736-22f5259085ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1752 microversion: 2.20 time: 0.159999 Dec 20 09:34:36.764666 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 526/1010] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:36 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:34:37.276514 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e0a88608-5348-41ae-871b-14c40f44230e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 21840 microversion: 2.1 time: 1.838626 Dec 20 09:34:37.277619 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 485/1011] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:34:35 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 21840 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:34:37.781885 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b790eb2b-cbfb-4221-aab7-ce831bd50b98 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:37.782598 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b790eb2b-cbfb-4221-aab7-ce831bd50b98 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:37.788816 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b790eb2b-cbfb-4221-aab7-ce831bd50b98 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:37.789245 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b790eb2b-cbfb-4221-aab7-ce831bd50b98 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:37.790024 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b790eb2b-cbfb-4221-aab7-ce831bd50b98 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:37.790462 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b790eb2b-cbfb-4221-aab7-ce831bd50b98 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:37.920444 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b790eb2b-cbfb-4221-aab7-ce831bd50b98 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:37.928560 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b790eb2b-cbfb-4221-aab7-ce831bd50b98 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:37.930045 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b790eb2b-cbfb-4221-aab7-ce831bd50b98 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:37.931197 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b790eb2b-cbfb-4221-aab7-ce831bd50b98 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1752 microversion: 2.20 time: 0.152982 Dec 20 09:34:37.931784 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 527/1012] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:37 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:38.288457 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-7ccb1e08-1d59-4272-b00f-8c1d81113143 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:38.289477 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-7ccb1e08-1d59-4272-b00f-8c1d81113143 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:38.296328 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7ccb1e08-1d59-4272-b00f-8c1d81113143 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:38.296783 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7ccb1e08-1d59-4272-b00f-8c1d81113143 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:38.297559 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7ccb1e08-1d59-4272-b00f-8c1d81113143 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:38.297997 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7ccb1e08-1d59-4272-b00f-8c1d81113143 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:38.949077 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0dc57b15-3b2b-49d6-8fd1-7b8d02e7db40 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:38.949767 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0dc57b15-3b2b-49d6-8fd1-7b8d02e7db40 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:38.955953 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0dc57b15-3b2b-49d6-8fd1-7b8d02e7db40 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:38.956398 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0dc57b15-3b2b-49d6-8fd1-7b8d02e7db40 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:38.957212 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0dc57b15-3b2b-49d6-8fd1-7b8d02e7db40 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:38.957688 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0dc57b15-3b2b-49d6-8fd1-7b8d02e7db40 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:39.082289 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-7ccb1e08-1d59-4272-b00f-8c1d81113143 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 23804 microversion: 2.1 time: 0.797604 Dec 20 09:34:39.086158 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 486/1013] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:34:38 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 23804 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:34:39.093952 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-0dc57b15-3b2b-49d6-8fd1-7b8d02e7db40 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:39.102157 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-0dc57b15-3b2b-49d6-8fd1-7b8d02e7db40 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:39.103637 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-0dc57b15-3b2b-49d6-8fd1-7b8d02e7db40 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:39.104798 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0dc57b15-3b2b-49d6-8fd1-7b8d02e7db40 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1752 microversion: 2.20 time: 0.159477 Dec 20 09:34:39.105844 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 528/1014] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:38 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:34:40.097050 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-54777b69-ef86-4d34-ae18-4231a5ea9ab0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:40.098078 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-54777b69-ef86-4d34-ae18-4231a5ea9ab0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:40.105647 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-54777b69-ef86-4d34-ae18-4231a5ea9ab0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:40.106102 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-54777b69-ef86-4d34-ae18-4231a5ea9ab0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:40.106881 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-54777b69-ef86-4d34-ae18-4231a5ea9ab0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:40.107317 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-54777b69-ef86-4d34-ae18-4231a5ea9ab0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:40.124533 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d4339fe6-5c20-484f-ae53-0612b68ee5bb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:40.125134 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d4339fe6-5c20-484f-ae53-0612b68ee5bb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:40.131340 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d4339fe6-5c20-484f-ae53-0612b68ee5bb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:40.131820 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d4339fe6-5c20-484f-ae53-0612b68ee5bb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:40.132603 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d4339fe6-5c20-484f-ae53-0612b68ee5bb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:40.133049 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d4339fe6-5c20-484f-ae53-0612b68ee5bb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:40.275698 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d4339fe6-5c20-484f-ae53-0612b68ee5bb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:40.284499 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d4339fe6-5c20-484f-ae53-0612b68ee5bb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:40.286131 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d4339fe6-5c20-484f-ae53-0612b68ee5bb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:40.287283 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d4339fe6-5c20-484f-ae53-0612b68ee5bb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1752 microversion: 2.20 time: 0.167324 Dec 20 09:34:40.288839 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 529/1015] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:40 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:34:40.412859 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-54777b69-ef86-4d34-ae18-4231a5ea9ab0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 25241 microversion: 2.1 time: 0.321256 Dec 20 09:34:40.413511 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 487/1016] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:34:40 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 25241 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:34:41.305068 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d7f03baa-d0ff-44d5-b2ad-cbb01eacbd05 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:41.305667 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d7f03baa-d0ff-44d5-b2ad-cbb01eacbd05 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:41.313233 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d7f03baa-d0ff-44d5-b2ad-cbb01eacbd05 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:41.313675 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d7f03baa-d0ff-44d5-b2ad-cbb01eacbd05 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:41.314473 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d7f03baa-d0ff-44d5-b2ad-cbb01eacbd05 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:41.314909 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d7f03baa-d0ff-44d5-b2ad-cbb01eacbd05 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:41.431089 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0fa96f42-42d7-44ac-ba4b-636b853ddc09 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:41.438734 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0fa96f42-42d7-44ac-ba4b-636b853ddc09 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:41.457626 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0fa96f42-42d7-44ac-ba4b-636b853ddc09 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:41.458623 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0fa96f42-42d7-44ac-ba4b-636b853ddc09 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:41.460018 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0fa96f42-42d7-44ac-ba4b-636b853ddc09 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:41.460684 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0fa96f42-42d7-44ac-ba4b-636b853ddc09 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:41.475138 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d7f03baa-d0ff-44d5-b2ad-cbb01eacbd05 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:41.484516 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d7f03baa-d0ff-44d5-b2ad-cbb01eacbd05 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:41.486313 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d7f03baa-d0ff-44d5-b2ad-cbb01eacbd05 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:41.487767 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d7f03baa-d0ff-44d5-b2ad-cbb01eacbd05 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1752 microversion: 2.20 time: 0.186551 Dec 20 09:34:41.502091 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 530/1017] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:41 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1752 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:41.566029 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0fa96f42-42d7-44ac-ba4b-636b853ddc09 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 26413 microversion: 2.1 time: 0.144803 Dec 20 09:34:41.566770 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 488/1018] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:34:41 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 26413 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:34:41.759724 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-543155aa-ab7d-4dff-b584-96734689d52f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:41.760336 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-543155aa-ab7d-4dff-b584-96734689d52f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:41.768881 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-543155aa-ab7d-4dff-b584-96734689d52f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:41.769323 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-543155aa-ab7d-4dff-b584-96734689d52f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:41.770120 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-543155aa-ab7d-4dff-b584-96734689d52f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:41.770557 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-543155aa-ab7d-4dff-b584-96734689d52f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:41.905525 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-543155aa-ab7d-4dff-b584-96734689d52f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:41.913998 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-543155aa-ab7d-4dff-b584-96734689d52f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1592 microversion: 2.1 time: 0.158121 Dec 20 09:34:41.914575 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 531/1019] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:41 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1592 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:42.509510 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-16990f2c-96a8-4fcf-a8a6-47cf4ff3738f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:42.510954 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-16990f2c-96a8-4fcf-a8a6-47cf4ff3738f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:42.518424 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-16990f2c-96a8-4fcf-a8a6-47cf4ff3738f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:42.518870 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-16990f2c-96a8-4fcf-a8a6-47cf4ff3738f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:42.519646 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-16990f2c-96a8-4fcf-a8a6-47cf4ff3738f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:42.520259 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-16990f2c-96a8-4fcf-a8a6-47cf4ff3738f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:42.577367 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7ac4e4c1-84b5-45a8-8647-a14c33bb7d3b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:42.578289 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7ac4e4c1-84b5-45a8-8647-a14c33bb7d3b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:42.587866 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7ac4e4c1-84b5-45a8-8647-a14c33bb7d3b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:42.588787 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7ac4e4c1-84b5-45a8-8647-a14c33bb7d3b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:42.592460 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7ac4e4c1-84b5-45a8-8647-a14c33bb7d3b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:42.592912 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7ac4e4c1-84b5-45a8-8647-a14c33bb7d3b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:42.668643 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-16990f2c-96a8-4fcf-a8a6-47cf4ff3738f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:42.679426 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-16990f2c-96a8-4fcf-a8a6-47cf4ff3738f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:42.680965 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-16990f2c-96a8-4fcf-a8a6-47cf4ff3738f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:42.682118 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-16990f2c-96a8-4fcf-a8a6-47cf4ff3738f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1752 microversion: 2.20 time: 0.176757 Dec 20 09:34:42.682773 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 489/1020] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:42 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:43.701005 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-519d427a-8dd0-4c76-bd02-21dffa7a8060 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:43.701638 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-519d427a-8dd0-4c76-bd02-21dffa7a8060 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:43.707812 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-519d427a-8dd0-4c76-bd02-21dffa7a8060 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:43.708273 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-519d427a-8dd0-4c76-bd02-21dffa7a8060 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:43.709057 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-519d427a-8dd0-4c76-bd02-21dffa7a8060 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:43.709551 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-519d427a-8dd0-4c76-bd02-21dffa7a8060 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:43.849081 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-519d427a-8dd0-4c76-bd02-21dffa7a8060 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:43.857872 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-519d427a-8dd0-4c76-bd02-21dffa7a8060 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:43.859387 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-519d427a-8dd0-4c76-bd02-21dffa7a8060 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:43.860563 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-519d427a-8dd0-4c76-bd02-21dffa7a8060 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1752 microversion: 2.20 time: 0.163844 Dec 20 09:34:43.861287 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 490/1021] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:43 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:44.388555 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-22575e72-b7fe-4c1b-811c-190e5d757834 req-8e0201fb-8314-423b-b821-47b0bfb23c58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8", "tag": "ca7f5f87-9783-4751-ad57-587b490d4b2d"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:44.390440 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:34:44.390440 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:34:44.398549 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-22575e72-b7fe-4c1b-811c-190e5d757834 req-8e0201fb-8314-423b-b821-47b0bfb23c58 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:44.399074 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-22575e72-b7fe-4c1b-811c-190e5d757834 req-8e0201fb-8314-423b-b821-47b0bfb23c58 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:44.416566 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-22575e72-b7fe-4c1b-811c-190e5d757834 req-8e0201fb-8314-423b-b821-47b0bfb23c58 service nova] Creating event network-changed:ca7f5f87-9783-4751-ad57-587b490d4b2d for instance 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 on hv-cinder-81908 Dec 20 09:34:44.421463 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-22575e72-b7fe-4c1b-811c-190e5d757834 req-8e0201fb-8314-423b-b821-47b0bfb23c58 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037043 Dec 20 09:34:44.422047 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 491/1022] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:34:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:34:44.880087 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-50003581-dadc-4bb4-8ae4-bc8ceccf7dc7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:44.880710 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-50003581-dadc-4bb4-8ae4-bc8ceccf7dc7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:44.887511 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-50003581-dadc-4bb4-8ae4-bc8ceccf7dc7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:44.888701 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-50003581-dadc-4bb4-8ae4-bc8ceccf7dc7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:44.889920 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-50003581-dadc-4bb4-8ae4-bc8ceccf7dc7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:44.891054 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-50003581-dadc-4bb4-8ae4-bc8ceccf7dc7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:45.088172 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-50003581-dadc-4bb4-8ae4-bc8ceccf7dc7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:45.096897 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-50003581-dadc-4bb4-8ae4-bc8ceccf7dc7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:45.098518 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-50003581-dadc-4bb4-8ae4-bc8ceccf7dc7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:45.099709 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-50003581-dadc-4bb4-8ae4-bc8ceccf7dc7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1752 microversion: 2.20 time: 0.224062 Dec 20 09:34:45.100429 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 492/1023] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:44 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1752 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:34:46.119251 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d0abc33e-1646-42f5-b8c4-cfd8b4c00ceb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:46.119859 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d0abc33e-1646-42f5-b8c4-cfd8b4c00ceb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:46.127072 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d0abc33e-1646-42f5-b8c4-cfd8b4c00ceb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:46.127622 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d0abc33e-1646-42f5-b8c4-cfd8b4c00ceb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:46.128471 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d0abc33e-1646-42f5-b8c4-cfd8b4c00ceb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:46.128905 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d0abc33e-1646-42f5-b8c4-cfd8b4c00ceb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:46.282724 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d0abc33e-1646-42f5-b8c4-cfd8b4c00ceb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:46.291021 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d0abc33e-1646-42f5-b8c4-cfd8b4c00ceb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:46.292645 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d0abc33e-1646-42f5-b8c4-cfd8b4c00ceb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:46.293820 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d0abc33e-1646-42f5-b8c4-cfd8b4c00ceb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1752 microversion: 2.20 time: 0.178534 Dec 20 09:34:46.304379 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 493/1024] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:46 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:46.607474 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7ac4e4c1-84b5-45a8-8647-a14c33bb7d3b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 27768 microversion: 2.1 time: 4.033466 Dec 20 09:34:46.611328 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 532/1025] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:34:42 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 27768 bytes in 4036 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 09:34:46.941534 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-31988144-3dbc-46cd-8914-fb674f260ae9 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-877171749"}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:46.942075 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-31988144-3dbc-46cd-8914-fb674f260ae9 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:46.948994 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-31988144-3dbc-46cd-8914-fb674f260ae9 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:46.949718 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-31988144-3dbc-46cd-8914-fb674f260ae9 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:46.950722 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-31988144-3dbc-46cd-8914-fb674f260ae9 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:46.951194 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-31988144-3dbc-46cd-8914-fb674f260ae9 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:47.084907 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.network.security_group_api [None req-31988144-3dbc-46cd-8914-fb674f260ae9 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Adding security group b5e8054d-b6dc-49e5-addb-dbb0c2005cae to port ca7f5f87-9783-4751-ad57-587b490d4b2d Dec 20 09:34:47.312713 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-dea847ae-c78d-4cc6-89df-f2b7e2f28813 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:47.313520 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-dea847ae-c78d-4cc6-89df-f2b7e2f28813 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:47.324068 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dea847ae-c78d-4cc6-89df-f2b7e2f28813 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:47.324068 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dea847ae-c78d-4cc6-89df-f2b7e2f28813 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:47.324068 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dea847ae-c78d-4cc6-89df-f2b7e2f28813 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:47.324068 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dea847ae-c78d-4cc6-89df-f2b7e2f28813 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:47.725096 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-31988144-3dbc-46cd-8914-fb674f260ae9 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "POST /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8/action" status: 202 len: 0 microversion: 2.1 time: 0.787302 Dec 20 09:34:47.726779 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 494/1026] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:34:46 2021] POST /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8/action => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:34:47.733348 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d071b563-bff4-4308-97cd-01407df95147 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:47.734530 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d071b563-bff4-4308-97cd-01407df95147 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:47.742700 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d071b563-bff4-4308-97cd-01407df95147 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:47.744473 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d071b563-bff4-4308-97cd-01407df95147 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:47.745807 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d071b563-bff4-4308-97cd-01407df95147 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:47.786299 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d071b563-bff4-4308-97cd-01407df95147 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:47.787573 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-dea847ae-c78d-4cc6-89df-f2b7e2f28813 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:47.787573 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-dea847ae-c78d-4cc6-89df-f2b7e2f28813 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:47.788082 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-dea847ae-c78d-4cc6-89df-f2b7e2f28813 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:47.788082 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-dea847ae-c78d-4cc6-89df-f2b7e2f28813 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1752 microversion: 2.20 time: 0.474296 Dec 20 09:34:47.788082 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 533/1027] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:47 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1752 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:34:47.797094 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d258f53a-6fbd-4591-8f6a-a1be35bf49b3 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:47.797999 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d258f53a-6fbd-4591-8f6a-a1be35bf49b3 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:47.804995 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d258f53a-6fbd-4591-8f6a-a1be35bf49b3 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:47.805852 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d258f53a-6fbd-4591-8f6a-a1be35bf49b3 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:47.806830 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d258f53a-6fbd-4591-8f6a-a1be35bf49b3 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:47.807436 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d258f53a-6fbd-4591-8f6a-a1be35bf49b3 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:47.866886 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d071b563-bff4-4308-97cd-01407df95147 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 27884 microversion: 2.1 time: 0.122785 Dec 20 09:34:47.867626 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 495/1028] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:34:47 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 27884 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:34:47.888540 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-55e7c5ff-3c49-4a6f-a6ab-f482b45046d6 req-65e69745-0e5d-4f0b-aa40-548a3238e9fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8", "tag": "ca7f5f87-9783-4751-ad57-587b490d4b2d"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:47.896692 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:34:47.896692 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:34:47.923490 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-55e7c5ff-3c49-4a6f-a6ab-f482b45046d6 req-65e69745-0e5d-4f0b-aa40-548a3238e9fd service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:47.924117 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-55e7c5ff-3c49-4a6f-a6ab-f482b45046d6 req-65e69745-0e5d-4f0b-aa40-548a3238e9fd service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:47.941920 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-55e7c5ff-3c49-4a6f-a6ab-f482b45046d6 req-65e69745-0e5d-4f0b-aa40-548a3238e9fd service nova] Creating event network-changed:ca7f5f87-9783-4751-ad57-587b490d4b2d for instance 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 on hv-cinder-81908 Dec 20 09:34:47.947251 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-55e7c5ff-3c49-4a6f-a6ab-f482b45046d6 req-65e69745-0e5d-4f0b-aa40-548a3238e9fd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067299 Dec 20 09:34:47.947904 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 496/1029] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:34:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:34:48.074957 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d258f53a-6fbd-4591-8f6a-a1be35bf49b3 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:48.082768 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d258f53a-6fbd-4591-8f6a-a1be35bf49b3 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1757 microversion: 2.1 time: 0.298839 Dec 20 09:34:48.083341 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 534/1030] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:34:47 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1757 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:34:48.802051 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b94c9d15-9c77-490a-b0e1-34f03469ad24 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:48.802793 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b94c9d15-9c77-490a-b0e1-34f03469ad24 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:48.809490 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b94c9d15-9c77-490a-b0e1-34f03469ad24 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:48.809949 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b94c9d15-9c77-490a-b0e1-34f03469ad24 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:48.810719 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b94c9d15-9c77-490a-b0e1-34f03469ad24 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:48.811155 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b94c9d15-9c77-490a-b0e1-34f03469ad24 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:48.878667 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-fdbc9987-ac45-4496-ab56-ba15c7af1b66 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:48.879687 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-fdbc9987-ac45-4496-ab56-ba15c7af1b66 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:48.885907 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fdbc9987-ac45-4496-ab56-ba15c7af1b66 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:48.886358 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fdbc9987-ac45-4496-ab56-ba15c7af1b66 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:48.887146 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fdbc9987-ac45-4496-ab56-ba15c7af1b66 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:48.887590 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fdbc9987-ac45-4496-ab56-ba15c7af1b66 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:48.943582 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b94c9d15-9c77-490a-b0e1-34f03469ad24 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:48.952007 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b94c9d15-9c77-490a-b0e1-34f03469ad24 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:48.953514 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b94c9d15-9c77-490a-b0e1-34f03469ad24 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:48.954658 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b94c9d15-9c77-490a-b0e1-34f03469ad24 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.157229 Dec 20 09:34:48.955213 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 497/1031] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:48 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:48.972205 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-fdbc9987-ac45-4496-ab56-ba15c7af1b66 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 28011 microversion: 2.1 time: 0.096979 Dec 20 09:34:48.973056 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 535/1032] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:34:48 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 28011 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 09:34:49.976000 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-08f9a748-5332-4eec-b727-e7fe77d4e2ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:49.976605 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-08f9a748-5332-4eec-b727-e7fe77d4e2ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:49.983425 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-08f9a748-5332-4eec-b727-e7fe77d4e2ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:49.983903 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-08f9a748-5332-4eec-b727-e7fe77d4e2ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:49.984206 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-79219231-432b-42a3-92d3-03543b402b35 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:49.984678 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-08f9a748-5332-4eec-b727-e7fe77d4e2ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:49.985080 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-08f9a748-5332-4eec-b727-e7fe77d4e2ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:49.986112 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-79219231-432b-42a3-92d3-03543b402b35 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:49.994311 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-79219231-432b-42a3-92d3-03543b402b35 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:49.995882 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-79219231-432b-42a3-92d3-03543b402b35 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:49.997390 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-79219231-432b-42a3-92d3-03543b402b35 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:49.998152 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-79219231-432b-42a3-92d3-03543b402b35 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:50.083267 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-79219231-432b-42a3-92d3-03543b402b35 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 28129 microversion: 2.1 time: 0.102746 Dec 20 09:34:50.084266 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 536/1033] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:34:49 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 28129 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 09:34:50.133341 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-08f9a748-5332-4eec-b727-e7fe77d4e2ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:50.145753 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-08f9a748-5332-4eec-b727-e7fe77d4e2ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:50.147438 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-08f9a748-5332-4eec-b727-e7fe77d4e2ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:50.148635 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-08f9a748-5332-4eec-b727-e7fe77d4e2ef tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.176402 Dec 20 09:34:50.149459 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 498/1034] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:49 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:51.097804 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9d132435-f8fc-4762-bfd2-0665b03971e4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:34:51.098937 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9d132435-f8fc-4762-bfd2-0665b03971e4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:51.107307 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9d132435-f8fc-4762-bfd2-0665b03971e4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:51.107790 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9d132435-f8fc-4762-bfd2-0665b03971e4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:51.108596 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9d132435-f8fc-4762-bfd2-0665b03971e4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:51.109043 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9d132435-f8fc-4762-bfd2-0665b03971e4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:51.166462 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-acec8862-2e8e-4fe4-aa59-3caee1b70c1e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:51.167626 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-acec8862-2e8e-4fe4-aa59-3caee1b70c1e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:51.174522 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-acec8862-2e8e-4fe4-aa59-3caee1b70c1e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:51.174982 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-acec8862-2e8e-4fe4-aa59-3caee1b70c1e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:51.175805 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-acec8862-2e8e-4fe4-aa59-3caee1b70c1e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:51.176247 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-acec8862-2e8e-4fe4-aa59-3caee1b70c1e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:51.310732 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-acec8862-2e8e-4fe4-aa59-3caee1b70c1e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:51.319193 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-acec8862-2e8e-4fe4-aa59-3caee1b70c1e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:51.320720 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-acec8862-2e8e-4fe4-aa59-3caee1b70c1e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:51.321888 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-acec8862-2e8e-4fe4-aa59-3caee1b70c1e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.159425 Dec 20 09:34:51.322459 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 499/1035] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:51 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:34:51.449287 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9eee0d40-ed66-4237-bd77-6782a61ee7ef tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:51.449783 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9eee0d40-ed66-4237-bd77-6782a61ee7ef tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:51.455887 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9eee0d40-ed66-4237-bd77-6782a61ee7ef tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:51.456339 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9eee0d40-ed66-4237-bd77-6782a61ee7ef tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:51.457116 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9eee0d40-ed66-4237-bd77-6782a61ee7ef tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:51.457552 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9eee0d40-ed66-4237-bd77-6782a61ee7ef tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:51.537467 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.objects.instance [None req-9eee0d40-ed66-4237-bd77-6782a61ee7ef tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lazy-loading 'services' on Instance uuid 10894e50-9f92-4712-9add-ca91cb29ae5f {{(pid=116675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:34:51.817559 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9eee0d40-ed66-4237-bd77-6782a61ee7ef tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "DELETE /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f/os-volume_attachments/8e2df48e-a2f7-44b6-895d-5204f1a46397" status: 202 len: 0 microversion: 2.1 time: 0.371837 Dec 20 09:34:51.818254 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 500/1036] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 20 09:34:51 2021] DELETE /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f/os-volume_attachments/8e2df48e-a2f7-44b6-895d-5204f1a46397 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:34:52.340332 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-31658ff8-fd33-44a1-9c39-c07d8dfb1cad tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:52.341144 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-31658ff8-fd33-44a1-9c39-c07d8dfb1cad tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:52.347933 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-31658ff8-fd33-44a1-9c39-c07d8dfb1cad tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:52.348390 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-31658ff8-fd33-44a1-9c39-c07d8dfb1cad tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:52.349180 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-31658ff8-fd33-44a1-9c39-c07d8dfb1cad tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:52.349614 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-31658ff8-fd33-44a1-9c39-c07d8dfb1cad tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:52.528897 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-31658ff8-fd33-44a1-9c39-c07d8dfb1cad tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:52.538147 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-31658ff8-fd33-44a1-9c39-c07d8dfb1cad tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:52.540137 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-31658ff8-fd33-44a1-9c39-c07d8dfb1cad tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:52.542436 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-31658ff8-fd33-44a1-9c39-c07d8dfb1cad tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.205667 Dec 20 09:34:52.543037 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 501/1037] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:52 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:34:53.561546 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8d665480-7043-47bd-bc15-34be45e81cf3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:53.562244 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8d665480-7043-47bd-bc15-34be45e81cf3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:53.568610 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8d665480-7043-47bd-bc15-34be45e81cf3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:53.569094 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8d665480-7043-47bd-bc15-34be45e81cf3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:53.569961 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8d665480-7043-47bd-bc15-34be45e81cf3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:53.570397 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8d665480-7043-47bd-bc15-34be45e81cf3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:53.712940 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8d665480-7043-47bd-bc15-34be45e81cf3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:53.721273 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8d665480-7043-47bd-bc15-34be45e81cf3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:53.722720 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8d665480-7043-47bd-bc15-34be45e81cf3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:53.723933 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8d665480-7043-47bd-bc15-34be45e81cf3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.166565 Dec 20 09:34:53.724524 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 502/1038] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:53 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:34:54.762493 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-576b01a4-21cc-42fe-ba1a-e675418f0d93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:54.764374 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-576b01a4-21cc-42fe-ba1a-e675418f0d93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:54.780878 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-576b01a4-21cc-42fe-ba1a-e675418f0d93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:54.780878 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-576b01a4-21cc-42fe-ba1a-e675418f0d93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:54.780878 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-576b01a4-21cc-42fe-ba1a-e675418f0d93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:54.780878 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-576b01a4-21cc-42fe-ba1a-e675418f0d93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:54.919949 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-576b01a4-21cc-42fe-ba1a-e675418f0d93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:54.928519 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-576b01a4-21cc-42fe-ba1a-e675418f0d93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:54.930142 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-576b01a4-21cc-42fe-ba1a-e675418f0d93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:54.931474 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-576b01a4-21cc-42fe-ba1a-e675418f0d93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.173975 Dec 20 09:34:54.932156 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 503/1039] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:54 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:34:55.949885 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d91de9fc-daa0-414c-abe2-b23d883440f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:55.950686 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d91de9fc-daa0-414c-abe2-b23d883440f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:56.034448 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d91de9fc-daa0-414c-abe2-b23d883440f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:56.034862 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d91de9fc-daa0-414c-abe2-b23d883440f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:56.035650 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d91de9fc-daa0-414c-abe2-b23d883440f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:56.036375 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d91de9fc-daa0-414c-abe2-b23d883440f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:56.212002 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d91de9fc-daa0-414c-abe2-b23d883440f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:56.219287 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d91de9fc-daa0-414c-abe2-b23d883440f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:56.221059 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d91de9fc-daa0-414c-abe2-b23d883440f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:56.222236 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d91de9fc-daa0-414c-abe2-b23d883440f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.276643 Dec 20 09:34:56.222825 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 504/1040] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:55 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:34:57.241159 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f3a36c65-3979-48ba-9297-d121718bc4a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:57.242314 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f3a36c65-3979-48ba-9297-d121718bc4a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:57.250633 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f3a36c65-3979-48ba-9297-d121718bc4a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:57.251322 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f3a36c65-3979-48ba-9297-d121718bc4a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:57.252479 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f3a36c65-3979-48ba-9297-d121718bc4a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:57.253039 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f3a36c65-3979-48ba-9297-d121718bc4a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:57.413319 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f3a36c65-3979-48ba-9297-d121718bc4a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:57.423780 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f3a36c65-3979-48ba-9297-d121718bc4a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:57.425379 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f3a36c65-3979-48ba-9297-d121718bc4a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:57.426542 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f3a36c65-3979-48ba-9297-d121718bc4a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.189508 Dec 20 09:34:57.427100 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 505/1041] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:57 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:34:58.446898 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e57f1151-f3bf-4f4f-a7c5-1cad696230bb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:58.448157 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e57f1151-f3bf-4f4f-a7c5-1cad696230bb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:58.456221 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e57f1151-f3bf-4f4f-a7c5-1cad696230bb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:58.456973 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e57f1151-f3bf-4f4f-a7c5-1cad696230bb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:58.457941 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e57f1151-f3bf-4f4f-a7c5-1cad696230bb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:58.458636 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e57f1151-f3bf-4f4f-a7c5-1cad696230bb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:58.630872 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e57f1151-f3bf-4f4f-a7c5-1cad696230bb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:58.648555 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e57f1151-f3bf-4f4f-a7c5-1cad696230bb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:58.650021 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e57f1151-f3bf-4f4f-a7c5-1cad696230bb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:34:58.651407 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e57f1151-f3bf-4f4f-a7c5-1cad696230bb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.208369 Dec 20 09:34:58.652290 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 506/1042] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:58 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:34:59.671369 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d1fca9a1-1bb1-4b4d-8e8d-5211da63ea9e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:34:59.673016 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d1fca9a1-1bb1-4b4d-8e8d-5211da63ea9e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:34:59.679005 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1fca9a1-1bb1-4b4d-8e8d-5211da63ea9e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:59.679782 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1fca9a1-1bb1-4b4d-8e8d-5211da63ea9e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:34:59.680937 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1fca9a1-1bb1-4b4d-8e8d-5211da63ea9e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:34:59.681578 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1fca9a1-1bb1-4b4d-8e8d-5211da63ea9e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:00.090755 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d1fca9a1-1bb1-4b4d-8e8d-5211da63ea9e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:00.098989 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d1fca9a1-1bb1-4b4d-8e8d-5211da63ea9e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:00.100774 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d1fca9a1-1bb1-4b4d-8e8d-5211da63ea9e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:00.102251 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d1fca9a1-1bb1-4b4d-8e8d-5211da63ea9e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.435950 Dec 20 09:35:00.102807 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 507/1043] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:34:59 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:35:01.120058 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b73e355c-924f-4df9-bca9-f03ad4c07c44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:01.121086 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b73e355c-924f-4df9-bca9-f03ad4c07c44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:01.127320 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b73e355c-924f-4df9-bca9-f03ad4c07c44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:01.127885 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b73e355c-924f-4df9-bca9-f03ad4c07c44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:01.128733 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b73e355c-924f-4df9-bca9-f03ad4c07c44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:01.129242 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b73e355c-924f-4df9-bca9-f03ad4c07c44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:01.268832 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b73e355c-924f-4df9-bca9-f03ad4c07c44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:01.278150 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b73e355c-924f-4df9-bca9-f03ad4c07c44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:01.279770 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b73e355c-924f-4df9-bca9-f03ad4c07c44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:01.281024 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b73e355c-924f-4df9-bca9-f03ad4c07c44 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.164652 Dec 20 09:35:01.289829 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 508/1044] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:01 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:35:02.299541 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-be4e6f3a-7927-43b5-860d-3437800181e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:02.300299 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-be4e6f3a-7927-43b5-860d-3437800181e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:02.306505 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-be4e6f3a-7927-43b5-860d-3437800181e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:02.310819 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-be4e6f3a-7927-43b5-860d-3437800181e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:02.310819 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-be4e6f3a-7927-43b5-860d-3437800181e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:02.310819 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-be4e6f3a-7927-43b5-860d-3437800181e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:02.444132 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-be4e6f3a-7927-43b5-860d-3437800181e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:02.452249 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-be4e6f3a-7927-43b5-860d-3437800181e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:02.453722 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-be4e6f3a-7927-43b5-860d-3437800181e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:02.454861 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-be4e6f3a-7927-43b5-860d-3437800181e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.159050 Dec 20 09:35:02.455424 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 509/1045] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:02 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:35:03.473521 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a0fc23af-43e6-42f4-9337-d557cd327dc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:03.474175 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a0fc23af-43e6-42f4-9337-d557cd327dc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:03.482118 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a0fc23af-43e6-42f4-9337-d557cd327dc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:03.482564 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a0fc23af-43e6-42f4-9337-d557cd327dc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:03.483349 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a0fc23af-43e6-42f4-9337-d557cd327dc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:03.483813 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a0fc23af-43e6-42f4-9337-d557cd327dc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:03.622759 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a0fc23af-43e6-42f4-9337-d557cd327dc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:03.631476 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a0fc23af-43e6-42f4-9337-d557cd327dc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:03.632970 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a0fc23af-43e6-42f4-9337-d557cd327dc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:03.634145 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a0fc23af-43e6-42f4-9337-d557cd327dc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.165117 Dec 20 09:35:03.634710 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 510/1046] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:03 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:35:04.653091 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-5efc8278-9050-4a71-8b0d-8cc50e0c251b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:04.653797 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-5efc8278-9050-4a71-8b0d-8cc50e0c251b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:04.659840 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5efc8278-9050-4a71-8b0d-8cc50e0c251b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:04.660286 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5efc8278-9050-4a71-8b0d-8cc50e0c251b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:04.661062 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5efc8278-9050-4a71-8b0d-8cc50e0c251b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:04.661493 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5efc8278-9050-4a71-8b0d-8cc50e0c251b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:04.793894 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-5efc8278-9050-4a71-8b0d-8cc50e0c251b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:04.802429 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-5efc8278-9050-4a71-8b0d-8cc50e0c251b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:04.803938 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-5efc8278-9050-4a71-8b0d-8cc50e0c251b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:04.805073 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-5efc8278-9050-4a71-8b0d-8cc50e0c251b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.155751 Dec 20 09:35:04.805635 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 511/1047] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:04 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:35:05.822965 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-363ad4a6-d9d4-483a-a4a4-9fb5b78538d4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:05.823616 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-363ad4a6-d9d4-483a-a4a4-9fb5b78538d4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:05.829866 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-363ad4a6-d9d4-483a-a4a4-9fb5b78538d4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:05.830313 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-363ad4a6-d9d4-483a-a4a4-9fb5b78538d4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:05.831086 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-363ad4a6-d9d4-483a-a4a4-9fb5b78538d4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:05.831520 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-363ad4a6-d9d4-483a-a4a4-9fb5b78538d4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:05.965666 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-363ad4a6-d9d4-483a-a4a4-9fb5b78538d4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:05.973994 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-363ad4a6-d9d4-483a-a4a4-9fb5b78538d4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:05.975517 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-363ad4a6-d9d4-483a-a4a4-9fb5b78538d4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:05.976687 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-363ad4a6-d9d4-483a-a4a4-9fb5b78538d4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.157614 Dec 20 09:35:05.977244 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 512/1048] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:05 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:35:06.806731 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9d132435-f8fc-4762-bfd2-0665b03971e4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 28246 microversion: 2.1 time: 15.715569 Dec 20 09:35:06.808817 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 537/1049] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:34:51 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 28246 bytes in 15718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:06.994141 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-516af31e-dd07-4480-8755-862511be2b43 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:06.995253 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-516af31e-dd07-4480-8755-862511be2b43 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:07.001762 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-516af31e-dd07-4480-8755-862511be2b43 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:07.002212 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-516af31e-dd07-4480-8755-862511be2b43 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:07.002988 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-516af31e-dd07-4480-8755-862511be2b43 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:07.003418 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-516af31e-dd07-4480-8755-862511be2b43 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:07.130901 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-516af31e-dd07-4480-8755-862511be2b43 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:07.139634 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-516af31e-dd07-4480-8755-862511be2b43 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:07.141139 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-516af31e-dd07-4480-8755-862511be2b43 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:07.142290 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-516af31e-dd07-4480-8755-862511be2b43 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.151919 Dec 20 09:35:07.142849 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 513/1050] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:06 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:35:07.818925 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-df637593-dd57-4280-80a1-30f34425e124 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:07.820693 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-df637593-dd57-4280-80a1-30f34425e124 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:07.828110 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-df637593-dd57-4280-80a1-30f34425e124 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:07.832496 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-df637593-dd57-4280-80a1-30f34425e124 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:07.832496 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-df637593-dd57-4280-80a1-30f34425e124 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:07.832496 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-df637593-dd57-4280-80a1-30f34425e124 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:07.902944 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-df637593-dd57-4280-80a1-30f34425e124 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 28246 microversion: 2.1 time: 0.088058 Dec 20 09:35:07.903642 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 538/1051] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:07 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 28246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:08.160414 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8fbf348f-b7a0-4af0-9591-39058b85c150 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:08.164412 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8fbf348f-b7a0-4af0-9591-39058b85c150 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:08.167987 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8fbf348f-b7a0-4af0-9591-39058b85c150 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:08.168430 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8fbf348f-b7a0-4af0-9591-39058b85c150 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:08.169191 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8fbf348f-b7a0-4af0-9591-39058b85c150 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:08.169624 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8fbf348f-b7a0-4af0-9591-39058b85c150 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:08.298871 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8fbf348f-b7a0-4af0-9591-39058b85c150 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:08.306998 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8fbf348f-b7a0-4af0-9591-39058b85c150 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:08.308488 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8fbf348f-b7a0-4af0-9591-39058b85c150 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:08.309611 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8fbf348f-b7a0-4af0-9591-39058b85c150 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.152954 Dec 20 09:35:08.310161 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 514/1052] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:08 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:35:08.743374 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-02bee9e5-e0c3-4bf5-8f3a-e877a5f715fd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:08.744002 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-02bee9e5-e0c3-4bf5-8f3a-e877a5f715fd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:08.751577 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-02bee9e5-e0c3-4bf5-8f3a-e877a5f715fd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:08.762140 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-02bee9e5-e0c3-4bf5-8f3a-e877a5f715fd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:08.762140 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-02bee9e5-e0c3-4bf5-8f3a-e877a5f715fd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:08.762140 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-02bee9e5-e0c3-4bf5-8f3a-e877a5f715fd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:08.779989 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-02bee9e5-e0c3-4bf5-8f3a-e877a5f715fd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Going to try to terminate instance {{(pid=116674) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 09:35:08.914101 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-54bed0f0-899e-4d82-ac97-dcfea63ff3d1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:08.915057 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-54bed0f0-899e-4d82-ac97-dcfea63ff3d1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:08.920817 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-54bed0f0-899e-4d82-ac97-dcfea63ff3d1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:08.921310 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-54bed0f0-899e-4d82-ac97-dcfea63ff3d1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:08.922103 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-54bed0f0-899e-4d82-ac97-dcfea63ff3d1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:08.922534 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-54bed0f0-899e-4d82-ac97-dcfea63ff3d1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:09.011599 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-54bed0f0-899e-4d82-ac97-dcfea63ff3d1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 28261 microversion: 2.1 time: 0.100796 Dec 20 09:35:09.012183 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 515/1053] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:08 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 28261 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 09:35:09.095836 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-02bee9e5-e0c3-4bf5-8f3a-e877a5f715fd tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "DELETE /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 204 len: 0 microversion: 2.1 time: 0.356114 Dec 20 09:35:09.096536 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 539/1054] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 20 09:35:08 2021] DELETE /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 09:35:09.105089 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8db29af4-55b1-42a8-b26c-9aa94e237e0f tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:09.105789 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8db29af4-55b1-42a8-b26c-9aa94e237e0f tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:09.112733 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8db29af4-55b1-42a8-b26c-9aa94e237e0f tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:09.113178 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8db29af4-55b1-42a8-b26c-9aa94e237e0f tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:09.113948 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8db29af4-55b1-42a8-b26c-9aa94e237e0f tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:09.114379 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8db29af4-55b1-42a8-b26c-9aa94e237e0f tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:09.250905 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8db29af4-55b1-42a8-b26c-9aa94e237e0f tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:09.259009 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8db29af4-55b1-42a8-b26c-9aa94e237e0f tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1512 microversion: 2.1 time: 0.157871 Dec 20 09:35:09.259581 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 516/1055] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:35:09 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:35:09.328103 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-51f96ac3-5ecb-470f-91e2-9cf755d63cdc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:09.328733 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-51f96ac3-5ecb-470f-91e2-9cf755d63cdc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:09.335667 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-51f96ac3-5ecb-470f-91e2-9cf755d63cdc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:09.336134 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-51f96ac3-5ecb-470f-91e2-9cf755d63cdc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:09.336916 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-51f96ac3-5ecb-470f-91e2-9cf755d63cdc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:09.337357 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-51f96ac3-5ecb-470f-91e2-9cf755d63cdc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:09.467817 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-51f96ac3-5ecb-470f-91e2-9cf755d63cdc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:09.476012 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-51f96ac3-5ecb-470f-91e2-9cf755d63cdc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:09.477506 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-51f96ac3-5ecb-470f-91e2-9cf755d63cdc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:09.478656 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-51f96ac3-5ecb-470f-91e2-9cf755d63cdc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.154756 Dec 20 09:35:09.479219 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 540/1056] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:09 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:35:10.022513 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4c312f45-672a-4385-8f5d-8a79672b2ff6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:10.023407 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4c312f45-672a-4385-8f5d-8a79672b2ff6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:10.030242 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4c312f45-672a-4385-8f5d-8a79672b2ff6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:10.030694 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4c312f45-672a-4385-8f5d-8a79672b2ff6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:10.031467 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4c312f45-672a-4385-8f5d-8a79672b2ff6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:10.031935 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4c312f45-672a-4385-8f5d-8a79672b2ff6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:10.277510 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-37824bbc-b8b5-4e76-8e53-363c39500dcb tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:10.277510 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-37824bbc-b8b5-4e76-8e53-363c39500dcb tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:10.285211 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37824bbc-b8b5-4e76-8e53-363c39500dcb tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:10.285652 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37824bbc-b8b5-4e76-8e53-363c39500dcb tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:10.286435 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37824bbc-b8b5-4e76-8e53-363c39500dcb tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:10.286865 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37824bbc-b8b5-4e76-8e53-363c39500dcb tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:10.414758 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-37824bbc-b8b5-4e76-8e53-363c39500dcb tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:10.422027 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-37824bbc-b8b5-4e76-8e53-363c39500dcb tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1512 microversion: 2.1 time: 0.149019 Dec 20 09:35:10.422591 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 541/1057] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:35:10 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:35:10.496457 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1acb4d16-385d-4256-a9d2-bbf781b7259a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:10.497053 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-1acb4d16-385d-4256-a9d2-bbf781b7259a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:10.502727 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1acb4d16-385d-4256-a9d2-bbf781b7259a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:10.503167 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1acb4d16-385d-4256-a9d2-bbf781b7259a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:10.504160 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1acb4d16-385d-4256-a9d2-bbf781b7259a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:10.504600 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1acb4d16-385d-4256-a9d2-bbf781b7259a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:10.646143 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1acb4d16-385d-4256-a9d2-bbf781b7259a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:10.655267 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1acb4d16-385d-4256-a9d2-bbf781b7259a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:10.656775 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1acb4d16-385d-4256-a9d2-bbf781b7259a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:10.657921 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1acb4d16-385d-4256-a9d2-bbf781b7259a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.165284 Dec 20 09:35:10.658477 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 542/1058] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:10 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:35:11.438629 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-fe1ee69c-b164-4bfe-beca-52b4a29d3c39 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:11.439242 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-fe1ee69c-b164-4bfe-beca-52b4a29d3c39 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:11.445497 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fe1ee69c-b164-4bfe-beca-52b4a29d3c39 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:11.445941 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fe1ee69c-b164-4bfe-beca-52b4a29d3c39 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:11.446717 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fe1ee69c-b164-4bfe-beca-52b4a29d3c39 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:11.447151 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fe1ee69c-b164-4bfe-beca-52b4a29d3c39 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:11.583095 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-fe1ee69c-b164-4bfe-beca-52b4a29d3c39 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:11.590926 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-fe1ee69c-b164-4bfe-beca-52b4a29d3c39 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1512 microversion: 2.1 time: 0.156049 Dec 20 09:35:11.591482 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 543/1059] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:35:11 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:35:11.675579 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8ee7bdfa-0f68-46f5-a892-f0bc299ff81f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:11.676265 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-8ee7bdfa-0f68-46f5-a892-f0bc299ff81f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:11.682019 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8ee7bdfa-0f68-46f5-a892-f0bc299ff81f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:11.687545 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8ee7bdfa-0f68-46f5-a892-f0bc299ff81f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:11.687545 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8ee7bdfa-0f68-46f5-a892-f0bc299ff81f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:11.687545 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8ee7bdfa-0f68-46f5-a892-f0bc299ff81f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:11.811277 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-8ee7bdfa-0f68-46f5-a892-f0bc299ff81f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:11.819470 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-8ee7bdfa-0f68-46f5-a892-f0bc299ff81f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:11.820993 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-8ee7bdfa-0f68-46f5-a892-f0bc299ff81f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:11.822148 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8ee7bdfa-0f68-46f5-a892-f0bc299ff81f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.150374 Dec 20 09:35:11.822714 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 544/1060] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:11 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:35:12.608960 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-da11f66c-c434-4288-a90b-f67582c724ea tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:12.609600 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-da11f66c-c434-4288-a90b-f67582c724ea tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:12.615801 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-da11f66c-c434-4288-a90b-f67582c724ea tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:12.616254 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-da11f66c-c434-4288-a90b-f67582c724ea tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:12.617039 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-da11f66c-c434-4288-a90b-f67582c724ea tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:12.617476 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-da11f66c-c434-4288-a90b-f67582c724ea tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:12.751815 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-da11f66c-c434-4288-a90b-f67582c724ea tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:12.759145 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-da11f66c-c434-4288-a90b-f67582c724ea tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1512 microversion: 2.1 time: 0.153949 Dec 20 09:35:12.760219 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 545/1061] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:35:12 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:35:12.839787 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-6979dd94-3be4-405c-b6b3-8c575ac7fc3c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:12.841036 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-6979dd94-3be4-405c-b6b3-8c575ac7fc3c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:12.846889 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6979dd94-3be4-405c-b6b3-8c575ac7fc3c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:12.847343 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6979dd94-3be4-405c-b6b3-8c575ac7fc3c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:12.848164 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6979dd94-3be4-405c-b6b3-8c575ac7fc3c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:12.848605 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6979dd94-3be4-405c-b6b3-8c575ac7fc3c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:12.985977 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-6979dd94-3be4-405c-b6b3-8c575ac7fc3c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:12.994724 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-6979dd94-3be4-405c-b6b3-8c575ac7fc3c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:12.996583 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-6979dd94-3be4-405c-b6b3-8c575ac7fc3c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:12.997738 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-6979dd94-3be4-405c-b6b3-8c575ac7fc3c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.161706 Dec 20 09:35:12.998287 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 546/1062] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:12 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:35:13.408848 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4c312f45-672a-4385-8f5d-8a79672b2ff6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 28537 microversion: 2.1 time: 3.389924 Dec 20 09:35:13.410048 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 517/1063] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:10 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 28537 bytes in 3392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:13.776773 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3f5c984b-a3af-43c3-9186-5fbf8209ecb9 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:13.777393 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-3f5c984b-a3af-43c3-9186-5fbf8209ecb9 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:13.783709 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3f5c984b-a3af-43c3-9186-5fbf8209ecb9 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:13.784163 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3f5c984b-a3af-43c3-9186-5fbf8209ecb9 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:13.784950 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3f5c984b-a3af-43c3-9186-5fbf8209ecb9 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:13.785389 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3f5c984b-a3af-43c3-9186-5fbf8209ecb9 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:13.916954 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3f5c984b-a3af-43c3-9186-5fbf8209ecb9 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:13.924245 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3f5c984b-a3af-43c3-9186-5fbf8209ecb9 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1512 microversion: 2.1 time: 0.151644 Dec 20 09:35:13.924812 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 547/1064] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:35:13 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:35:14.016462 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-44c3dbe2-e8f4-4949-acb1-3d126cdfa12d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:14.017236 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-44c3dbe2-e8f4-4949-acb1-3d126cdfa12d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:14.024095 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-44c3dbe2-e8f4-4949-acb1-3d126cdfa12d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:14.024546 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-44c3dbe2-e8f4-4949-acb1-3d126cdfa12d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:14.025866 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-44c3dbe2-e8f4-4949-acb1-3d126cdfa12d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:14.026303 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-44c3dbe2-e8f4-4949-acb1-3d126cdfa12d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:14.154482 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-44c3dbe2-e8f4-4949-acb1-3d126cdfa12d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:14.163041 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-44c3dbe2-e8f4-4949-acb1-3d126cdfa12d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:14.164545 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-44c3dbe2-e8f4-4949-acb1-3d126cdfa12d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:14.165688 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-44c3dbe2-e8f4-4949-acb1-3d126cdfa12d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.153813 Dec 20 09:35:14.166276 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 518/1065] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:14 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:35:14.419439 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ac569093-7f03-4f19-958d-c1d66d028af7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:14.420370 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ac569093-7f03-4f19-958d-c1d66d028af7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:14.426267 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac569093-7f03-4f19-958d-c1d66d028af7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:14.426718 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac569093-7f03-4f19-958d-c1d66d028af7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:14.427529 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac569093-7f03-4f19-958d-c1d66d028af7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:14.427996 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac569093-7f03-4f19-958d-c1d66d028af7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:14.638933 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ac569093-7f03-4f19-958d-c1d66d028af7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 28636 microversion: 2.1 time: 0.222997 Dec 20 09:35:14.639874 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 548/1066] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:14 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 28636 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:14.941022 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c9779172-ae96-4556-b4ee-b76748375e68 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:14.941632 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c9779172-ae96-4556-b4ee-b76748375e68 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:14.947971 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9779172-ae96-4556-b4ee-b76748375e68 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:14.948423 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9779172-ae96-4556-b4ee-b76748375e68 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:14.949198 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9779172-ae96-4556-b4ee-b76748375e68 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:14.949636 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9779172-ae96-4556-b4ee-b76748375e68 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:15.074044 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-c9779172-ae96-4556-b4ee-b76748375e68 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:15.081247 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c9779172-ae96-4556-b4ee-b76748375e68 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1512 microversion: 2.1 time: 0.143898 Dec 20 09:35:15.081819 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 519/1067] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:35:14 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1512 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:35:15.183842 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7ee91759-a8b5-4746-8af4-c183f3704c3e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:15.184536 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7ee91759-a8b5-4746-8af4-c183f3704c3e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:15.191341 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7ee91759-a8b5-4746-8af4-c183f3704c3e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:15.191822 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7ee91759-a8b5-4746-8af4-c183f3704c3e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:15.192596 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7ee91759-a8b5-4746-8af4-c183f3704c3e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:15.193035 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7ee91759-a8b5-4746-8af4-c183f3704c3e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:15.327024 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7ee91759-a8b5-4746-8af4-c183f3704c3e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:15.335336 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7ee91759-a8b5-4746-8af4-c183f3704c3e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:15.336864 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7ee91759-a8b5-4746-8af4-c183f3704c3e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:15.338587 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7ee91759-a8b5-4746-8af4-c183f3704c3e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.159443 Dec 20 09:35:15.339137 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 549/1068] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:15 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:35:15.650577 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-3f8dd5dd-541f-4b89-9d91-e1049df5a710 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:15.651474 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-3f8dd5dd-541f-4b89-9d91-e1049df5a710 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:15.657968 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3f8dd5dd-541f-4b89-9d91-e1049df5a710 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:15.658419 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3f8dd5dd-541f-4b89-9d91-e1049df5a710 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:15.659254 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3f8dd5dd-541f-4b89-9d91-e1049df5a710 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:15.659709 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3f8dd5dd-541f-4b89-9d91-e1049df5a710 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:16.097783 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d6dc7691-3a93-42fb-810c-9cfff17d1b0a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:16.098389 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d6dc7691-3a93-42fb-810c-9cfff17d1b0a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:16.104803 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d6dc7691-3a93-42fb-810c-9cfff17d1b0a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:16.105250 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d6dc7691-3a93-42fb-810c-9cfff17d1b0a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:16.106118 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d6dc7691-3a93-42fb-810c-9cfff17d1b0a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:16.106554 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d6dc7691-3a93-42fb-810c-9cfff17d1b0a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:16.233430 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d6dc7691-3a93-42fb-810c-9cfff17d1b0a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:16.240843 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d6dc7691-3a93-42fb-810c-9cfff17d1b0a tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1512 microversion: 2.1 time: 0.146694 Dec 20 09:35:16.241411 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 550/1069] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:35:16 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:35:16.357526 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e2dad585-d07d-43aa-85e9-dd37102ef4d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:16.358047 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e2dad585-d07d-43aa-85e9-dd37102ef4d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:16.364623 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e2dad585-d07d-43aa-85e9-dd37102ef4d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:16.365067 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e2dad585-d07d-43aa-85e9-dd37102ef4d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:16.365866 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e2dad585-d07d-43aa-85e9-dd37102ef4d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:16.366298 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e2dad585-d07d-43aa-85e9-dd37102ef4d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:16.496258 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e2dad585-d07d-43aa-85e9-dd37102ef4d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:16.504454 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e2dad585-d07d-43aa-85e9-dd37102ef4d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:16.505979 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e2dad585-d07d-43aa-85e9-dd37102ef4d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:16.507130 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e2dad585-d07d-43aa-85e9-dd37102ef4d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.154011 Dec 20 09:35:16.507709 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 551/1070] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:16 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:35:17.258000 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-79a4ab1d-2a56-44e5-84f4-b522021cd504 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:17.258629 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-79a4ab1d-2a56-44e5-84f4-b522021cd504 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:17.264774 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-79a4ab1d-2a56-44e5-84f4-b522021cd504 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:17.265222 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-79a4ab1d-2a56-44e5-84f4-b522021cd504 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:17.265999 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-79a4ab1d-2a56-44e5-84f4-b522021cd504 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:17.266433 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-79a4ab1d-2a56-44e5-84f4-b522021cd504 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:17.394290 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-79a4ab1d-2a56-44e5-84f4-b522021cd504 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:17.401711 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-79a4ab1d-2a56-44e5-84f4-b522021cd504 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1512 microversion: 2.1 time: 0.147381 Dec 20 09:35:17.402270 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 552/1071] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:35:17 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:35:17.525720 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-6118128b-a8e0-445a-9a74-ab015b20611d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:17.526248 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-6118128b-a8e0-445a-9a74-ab015b20611d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:17.532082 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6118128b-a8e0-445a-9a74-ab015b20611d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:17.532531 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6118128b-a8e0-445a-9a74-ab015b20611d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:17.533305 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6118128b-a8e0-445a-9a74-ab015b20611d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:17.533736 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6118128b-a8e0-445a-9a74-ab015b20611d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:17.662004 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-6118128b-a8e0-445a-9a74-ab015b20611d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:17.670131 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-6118128b-a8e0-445a-9a74-ab015b20611d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:17.671614 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-6118128b-a8e0-445a-9a74-ab015b20611d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:17.672881 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-6118128b-a8e0-445a-9a74-ab015b20611d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.151020 Dec 20 09:35:17.673434 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 553/1072] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:17 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:35:18.418141 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a15e2a86-ce6a-4ed7-8439-a39bcb3370f0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:18.418787 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a15e2a86-ce6a-4ed7-8439-a39bcb3370f0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:18.425053 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a15e2a86-ce6a-4ed7-8439-a39bcb3370f0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:18.425502 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a15e2a86-ce6a-4ed7-8439-a39bcb3370f0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:18.426283 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a15e2a86-ce6a-4ed7-8439-a39bcb3370f0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:18.426720 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a15e2a86-ce6a-4ed7-8439-a39bcb3370f0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:18.554858 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a15e2a86-ce6a-4ed7-8439-a39bcb3370f0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:18.562625 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a15e2a86-ce6a-4ed7-8439-a39bcb3370f0 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1512 microversion: 2.1 time: 0.148156 Dec 20 09:35:18.563190 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 554/1073] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:35:18 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:35:18.689945 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-fd5c1204-7e9e-4f29-b75d-92b18f275b2f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:18.690544 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-fd5c1204-7e9e-4f29-b75d-92b18f275b2f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:18.696429 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fd5c1204-7e9e-4f29-b75d-92b18f275b2f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:18.696916 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fd5c1204-7e9e-4f29-b75d-92b18f275b2f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:18.697685 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fd5c1204-7e9e-4f29-b75d-92b18f275b2f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:18.698196 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fd5c1204-7e9e-4f29-b75d-92b18f275b2f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:18.823832 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-fd5c1204-7e9e-4f29-b75d-92b18f275b2f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:18.831868 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-fd5c1204-7e9e-4f29-b75d-92b18f275b2f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:18.833343 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-fd5c1204-7e9e-4f29-b75d-92b18f275b2f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:18.834474 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-fd5c1204-7e9e-4f29-b75d-92b18f275b2f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.148245 Dec 20 09:35:18.835022 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 555/1074] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:18 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:35:19.538310 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-4114337b-a7fd-4103-867a-b0be82982c23 req-d343215c-1db0-41dc-b510-52d727577f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10894e50-9f92-4712-9add-ca91cb29ae5f", "name": "network-vif-unplugged", "status": "completed", "tag": "8fad1190-c366-409d-b720-5d2dffe5cc81"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:19.540367 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:35:19.540367 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:35:19.548679 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-4114337b-a7fd-4103-867a-b0be82982c23 req-d343215c-1db0-41dc-b510-52d727577f29 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:19.549123 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-4114337b-a7fd-4103-867a-b0be82982c23 req-d343215c-1db0-41dc-b510-52d727577f29 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:19.560455 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-4114337b-a7fd-4103-867a-b0be82982c23 req-d343215c-1db0-41dc-b510-52d727577f29 service nova] Creating event network-vif-unplugged:8fad1190-c366-409d-b720-5d2dffe5cc81 for instance 10894e50-9f92-4712-9add-ca91cb29ae5f on hv-cinder-81908 Dec 20 09:35:19.565955 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-4114337b-a7fd-4103-867a-b0be82982c23 req-d343215c-1db0-41dc-b510-52d727577f29 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031223 Dec 20 09:35:19.566262 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 556/1075] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:35:19 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:35:19.573265 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-3f8dd5dd-541f-4b89-9d91-e1049df5a710 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29559 microversion: 2.1 time: 3.926148 Dec 20 09:35:19.574273 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 520/1076] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:15 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29559 bytes in 3928 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:19.580200 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ac8bd314-8f9e-4206-90dc-878c099c1a73 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:19.580892 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ac8bd314-8f9e-4206-90dc-878c099c1a73 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:19.587023 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac8bd314-8f9e-4206-90dc-878c099c1a73 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:19.587488 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac8bd314-8f9e-4206-90dc-878c099c1a73 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:19.588320 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac8bd314-8f9e-4206-90dc-878c099c1a73 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:19.588749 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac8bd314-8f9e-4206-90dc-878c099c1a73 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:19.736188 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ac8bd314-8f9e-4206-90dc-878c099c1a73 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:19.744395 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ac8bd314-8f9e-4206-90dc-878c099c1a73 tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1512 microversion: 2.1 time: 0.167593 Dec 20 09:35:19.744964 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 557/1077] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:35:19 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:35:19.853717 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-65a8377c-b90e-4136-88fe-cdda943b6e9c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:19.854517 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-65a8377c-b90e-4136-88fe-cdda943b6e9c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:19.861260 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-65a8377c-b90e-4136-88fe-cdda943b6e9c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:19.861713 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-65a8377c-b90e-4136-88fe-cdda943b6e9c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:19.862487 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-65a8377c-b90e-4136-88fe-cdda943b6e9c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:19.862919 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-65a8377c-b90e-4136-88fe-cdda943b6e9c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:19.992808 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-65a8377c-b90e-4136-88fe-cdda943b6e9c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:20.002054 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-65a8377c-b90e-4136-88fe-cdda943b6e9c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:20.003566 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-65a8377c-b90e-4136-88fe-cdda943b6e9c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:20.005539 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-65a8377c-b90e-4136-88fe-cdda943b6e9c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.155817 Dec 20 09:35:20.006115 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 521/1078] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:19 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:35:20.087319 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-53524710-8052-49a7-85ae-93c4055c3675 req-97a6df32-c97e-49b3-b1bc-f333f2e59fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10894e50-9f92-4712-9add-ca91cb29ae5f", "name": "network-vif-deleted", "tag": "8fad1190-c366-409d-b720-5d2dffe5cc81"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:20.088842 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:35:20.088842 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:35:20.095516 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-53524710-8052-49a7-85ae-93c4055c3675 req-97a6df32-c97e-49b3-b1bc-f333f2e59fd0 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:20.095995 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-53524710-8052-49a7-85ae-93c4055c3675 req-97a6df32-c97e-49b3-b1bc-f333f2e59fd0 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:20.107062 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-53524710-8052-49a7-85ae-93c4055c3675 req-97a6df32-c97e-49b3-b1bc-f333f2e59fd0 service nova] Creating event network-vif-deleted:8fad1190-c366-409d-b720-5d2dffe5cc81 for instance 10894e50-9f92-4712-9add-ca91cb29ae5f on hv-cinder-81908 Dec 20 09:35:20.111975 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-53524710-8052-49a7-85ae-93c4055c3675 req-97a6df32-c97e-49b3-b1bc-f333f2e59fd0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028461 Dec 20 09:35:20.112547 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 558/1079] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:35:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:35:20.584792 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-50d163a4-4624-4edb-9657-f92f49c9aac9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:20.585863 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-50d163a4-4624-4edb-9657-f92f49c9aac9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:20.592684 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-50d163a4-4624-4edb-9657-f92f49c9aac9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:20.593136 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-50d163a4-4624-4edb-9657-f92f49c9aac9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:20.593925 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-50d163a4-4624-4edb-9657-f92f49c9aac9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:20.594363 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-50d163a4-4624-4edb-9657-f92f49c9aac9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:20.726264 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-50d163a4-4624-4edb-9657-f92f49c9aac9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.144966 Dec 20 09:35:20.727915 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 522/1080] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:20 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:20.761639 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-75bc6b26-7b10-4dd5-a1ba-427210963e4b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:20.762343 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-75bc6b26-7b10-4dd5-a1ba-427210963e4b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:20.769334 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-75bc6b26-7b10-4dd5-a1ba-427210963e4b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:20.769786 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-75bc6b26-7b10-4dd5-a1ba-427210963e4b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:20.770577 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-75bc6b26-7b10-4dd5-a1ba-427210963e4b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:20.771020 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-75bc6b26-7b10-4dd5-a1ba-427210963e4b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:20.803846 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-75bc6b26-7b10-4dd5-a1ba-427210963e4b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:20.804309 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-75bc6b26-7b10-4dd5-a1ba-427210963e4b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:20.804769 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.objects.instance [None req-75bc6b26-7b10-4dd5-a1ba-427210963e4b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lazy-loading 'fault' on Instance uuid 10894e50-9f92-4712-9add-ca91cb29ae5f {{(pid=116674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:35:20.844446 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-75bc6b26-7b10-4dd5-a1ba-427210963e4b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a8c4cf59e247bd8dfc5e285b20434d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b148577d1c274f06aa51efc897f84e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:20.851722 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-75bc6b26-7b10-4dd5-a1ba-427210963e4b tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 200 len: 1308 microversion: 2.1 time: 0.094028 Dec 20 09:35:20.852672 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 559/1081] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:35:20 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:35:21.023504 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4777b2e8-c05f-49b7-9a04-4b7d3aca38d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:21.024369 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4777b2e8-c05f-49b7-9a04-4b7d3aca38d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:21.033959 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4777b2e8-c05f-49b7-9a04-4b7d3aca38d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:21.034719 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4777b2e8-c05f-49b7-9a04-4b7d3aca38d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:21.036399 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4777b2e8-c05f-49b7-9a04-4b7d3aca38d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:21.037137 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4777b2e8-c05f-49b7-9a04-4b7d3aca38d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:21.192359 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-4777b2e8-c05f-49b7-9a04-4b7d3aca38d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:21.201631 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-4777b2e8-c05f-49b7-9a04-4b7d3aca38d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:21.203568 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-4777b2e8-c05f-49b7-9a04-4b7d3aca38d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:21.204867 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4777b2e8-c05f-49b7-9a04-4b7d3aca38d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.185236 Dec 20 09:35:21.205635 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 523/1082] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:21 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:35:21.580808 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-607ea0f0-d530-49b6-9117-7cb26c312759 req-ca558232-35e1-4fad-ad35-29fc9434b655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9ba0eda-fab4-44dc-b41f-0c51574dca1f", "name": "network-vif-plugged", "status": "completed", "tag": "b868aa5a-bfbe-4a31-ac51-6ef583b78b0e"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:21.582642 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:35:21.582642 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:35:21.589410 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-607ea0f0-d530-49b6-9117-7cb26c312759 req-ca558232-35e1-4fad-ad35-29fc9434b655 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:21.589847 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-607ea0f0-d530-49b6-9117-7cb26c312759 req-ca558232-35e1-4fad-ad35-29fc9434b655 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:21.600637 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-607ea0f0-d530-49b6-9117-7cb26c312759 req-ca558232-35e1-4fad-ad35-29fc9434b655 service nova] Creating event network-vif-plugged:b868aa5a-bfbe-4a31-ac51-6ef583b78b0e for instance c9ba0eda-fab4-44dc-b41f-0c51574dca1f on hv-cinder-81908 Dec 20 09:35:21.606134 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-607ea0f0-d530-49b6-9117-7cb26c312759 req-ca558232-35e1-4fad-ad35-29fc9434b655 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029250 Dec 20 09:35:21.610430 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 560/1083] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:35:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:35:21.738117 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-fe12ebce-a655-47b0-8e50-738a7e529360 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:21.739004 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-fe12ebce-a655-47b0-8e50-738a7e529360 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:21.746047 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fe12ebce-a655-47b0-8e50-738a7e529360 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:21.746489 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fe12ebce-a655-47b0-8e50-738a7e529360 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:21.747247 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fe12ebce-a655-47b0-8e50-738a7e529360 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:21.747690 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fe12ebce-a655-47b0-8e50-738a7e529360 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:21.869691 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5cceaed0-ecaa-4a7d-b65a-57ddc138ab0d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:21.870650 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-5cceaed0-ecaa-4a7d-b65a-57ddc138ab0d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] [instance: 10894e50-9f92-4712-9add-ca91cb29ae5f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:21.877125 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5cceaed0-ecaa-4a7d-b65a-57ddc138ab0d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:21.877574 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5cceaed0-ecaa-4a7d-b65a-57ddc138ab0d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:21.878356 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5cceaed0-ecaa-4a7d-b65a-57ddc138ab0d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:21.878795 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5cceaed0-ecaa-4a7d-b65a-57ddc138ab0d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:21.891502 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.wsgi [None req-5cceaed0-ecaa-4a7d-b65a-57ddc138ab0d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] HTTP exception thrown: Instance 10894e50-9f92-4712-9add-ca91cb29ae5f could not be found. Dec 20 09:35:21.892113 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5cceaed0-ecaa-4a7d-b65a-57ddc138ab0d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] Returning 404 to user: Instance 10894e50-9f92-4712-9add-ca91cb29ae5f could not be found. {{(pid=116674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:35:21.892920 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-5cceaed0-ecaa-4a7d-b65a-57ddc138ab0d tempest-VolumesSnapshotTestJSON-146549212 tempest-VolumesSnapshotTestJSON-146549212-project] 10.222.0.62 "GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f" status: 404 len: 111 microversion: 2.1 time: 0.027858 Dec 20 09:35:21.893439 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 561/1084] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:35:21 2021] GET /compute/v2.1/servers/10894e50-9f92-4712-9add-ca91cb29ae5f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 20 09:35:22.222818 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-dcabb718-88e6-4bba-8230-49c84ddcf2d2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:22.223431 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-dcabb718-88e6-4bba-8230-49c84ddcf2d2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:22.230081 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dcabb718-88e6-4bba-8230-49c84ddcf2d2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:22.230532 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dcabb718-88e6-4bba-8230-49c84ddcf2d2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:22.231313 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dcabb718-88e6-4bba-8230-49c84ddcf2d2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:22.231817 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dcabb718-88e6-4bba-8230-49c84ddcf2d2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:22.362381 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-dcabb718-88e6-4bba-8230-49c84ddcf2d2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:22.371250 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-dcabb718-88e6-4bba-8230-49c84ddcf2d2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:22.372811 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-dcabb718-88e6-4bba-8230-49c84ddcf2d2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:22.374012 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-dcabb718-88e6-4bba-8230-49c84ddcf2d2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.154888 Dec 20 09:35:22.380078 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 562/1085] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:22 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:35:23.392915 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9f5d3976-4421-4568-811a-15ba250fdbe5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:23.393536 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9f5d3976-4421-4568-811a-15ba250fdbe5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:23.399963 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9f5d3976-4421-4568-811a-15ba250fdbe5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:23.400413 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9f5d3976-4421-4568-811a-15ba250fdbe5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:23.401221 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9f5d3976-4421-4568-811a-15ba250fdbe5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:23.401658 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9f5d3976-4421-4568-811a-15ba250fdbe5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:23.532703 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-9f5d3976-4421-4568-811a-15ba250fdbe5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:23.541426 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-9f5d3976-4421-4568-811a-15ba250fdbe5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:23.542931 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-9f5d3976-4421-4568-811a-15ba250fdbe5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:23.544148 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9f5d3976-4421-4568-811a-15ba250fdbe5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.154950 Dec 20 09:35:23.544712 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 563/1086] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:23 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:35:24.562215 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b554f3e9-6cf2-4954-884a-34eceb6a3dec tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:24.562857 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b554f3e9-6cf2-4954-884a-34eceb6a3dec tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:24.569167 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b554f3e9-6cf2-4954-884a-34eceb6a3dec tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:24.569636 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b554f3e9-6cf2-4954-884a-34eceb6a3dec tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:24.570387 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b554f3e9-6cf2-4954-884a-34eceb6a3dec tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:24.570829 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b554f3e9-6cf2-4954-884a-34eceb6a3dec tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:24.704400 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b554f3e9-6cf2-4954-884a-34eceb6a3dec tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:24.712885 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b554f3e9-6cf2-4954-884a-34eceb6a3dec tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:24.714388 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b554f3e9-6cf2-4954-884a-34eceb6a3dec tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:24.715533 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b554f3e9-6cf2-4954-884a-34eceb6a3dec tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.157024 Dec 20 09:35:24.716171 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 564/1087] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:24 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:35:25.086499 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-fe12ebce-a655-47b0-8e50-738a7e529360 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 3.351811 Dec 20 09:35:25.087690 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 524/1088] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:21 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 3354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 09:35:25.733354 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-26126d5a-f930-4819-ab3f-4cd2c5b319dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:25.733917 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-26126d5a-f930-4819-ab3f-4cd2c5b319dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:25.740189 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-26126d5a-f930-4819-ab3f-4cd2c5b319dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:25.740643 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-26126d5a-f930-4819-ab3f-4cd2c5b319dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:25.741425 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-26126d5a-f930-4819-ab3f-4cd2c5b319dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:25.741862 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-26126d5a-f930-4819-ab3f-4cd2c5b319dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:25.867726 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-26126d5a-f930-4819-ab3f-4cd2c5b319dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:25.876659 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-26126d5a-f930-4819-ab3f-4cd2c5b319dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:25.878160 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-26126d5a-f930-4819-ab3f-4cd2c5b319dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:25.879315 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-26126d5a-f930-4819-ab3f-4cd2c5b319dc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.149772 Dec 20 09:35:25.879930 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 565/1089] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:25 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:35:26.098656 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-adfe0dc3-2465-4f0b-b0a7-5ceb297086c7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:26.099596 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-adfe0dc3-2465-4f0b-b0a7-5ceb297086c7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:26.107172 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-adfe0dc3-2465-4f0b-b0a7-5ceb297086c7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:26.107623 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-adfe0dc3-2465-4f0b-b0a7-5ceb297086c7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:26.108443 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-adfe0dc3-2465-4f0b-b0a7-5ceb297086c7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:26.108884 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-adfe0dc3-2465-4f0b-b0a7-5ceb297086c7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:26.178310 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-adfe0dc3-2465-4f0b-b0a7-5ceb297086c7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.083539 Dec 20 09:35:26.179212 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 525/1090] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:26 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:26.897432 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-999b235f-6a01-4ee0-b7e3-0801aa1ae5c2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:26.898039 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-999b235f-6a01-4ee0-b7e3-0801aa1ae5c2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:26.904814 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-999b235f-6a01-4ee0-b7e3-0801aa1ae5c2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:26.905264 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-999b235f-6a01-4ee0-b7e3-0801aa1ae5c2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:26.906146 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-999b235f-6a01-4ee0-b7e3-0801aa1ae5c2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:26.906582 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-999b235f-6a01-4ee0-b7e3-0801aa1ae5c2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:27.042648 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-999b235f-6a01-4ee0-b7e3-0801aa1ae5c2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:27.050930 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-999b235f-6a01-4ee0-b7e3-0801aa1ae5c2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:27.052511 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-999b235f-6a01-4ee0-b7e3-0801aa1ae5c2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:27.053728 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-999b235f-6a01-4ee0-b7e3-0801aa1ae5c2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.160000 Dec 20 09:35:27.054290 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 566/1091] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:26 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:35:27.190980 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b55453c6-1d60-4649-9503-55f450a409e3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:27.191942 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b55453c6-1d60-4649-9503-55f450a409e3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:27.199230 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b55453c6-1d60-4649-9503-55f450a409e3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:27.199700 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b55453c6-1d60-4649-9503-55f450a409e3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:27.200479 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b55453c6-1d60-4649-9503-55f450a409e3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:27.200920 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b55453c6-1d60-4649-9503-55f450a409e3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:27.279340 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b55453c6-1d60-4649-9503-55f450a409e3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.092281 Dec 20 09:35:27.280032 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 526/1092] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:27 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:28.072258 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d61e1b94-33db-489e-bd76-4671264ea1b6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:28.074477 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d61e1b94-33db-489e-bd76-4671264ea1b6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:28.080979 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d61e1b94-33db-489e-bd76-4671264ea1b6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:28.081424 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d61e1b94-33db-489e-bd76-4671264ea1b6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:28.082367 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d61e1b94-33db-489e-bd76-4671264ea1b6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:28.082798 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d61e1b94-33db-489e-bd76-4671264ea1b6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:28.225947 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d61e1b94-33db-489e-bd76-4671264ea1b6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:28.234881 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d61e1b94-33db-489e-bd76-4671264ea1b6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:28.236414 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d61e1b94-33db-489e-bd76-4671264ea1b6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:28.237585 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d61e1b94-33db-489e-bd76-4671264ea1b6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.169850 Dec 20 09:35:28.238149 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 567/1093] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:28 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:35:28.295976 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0cee54f9-607c-4158-932b-c2f01cefa119 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:28.295976 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0cee54f9-607c-4158-932b-c2f01cefa119 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:28.300311 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0cee54f9-607c-4158-932b-c2f01cefa119 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:28.300918 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0cee54f9-607c-4158-932b-c2f01cefa119 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:28.301698 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0cee54f9-607c-4158-932b-c2f01cefa119 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:28.302253 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0cee54f9-607c-4158-932b-c2f01cefa119 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:28.371368 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0cee54f9-607c-4158-932b-c2f01cefa119 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.084018 Dec 20 09:35:28.372331 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 527/1094] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:28 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:29.255885 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1881592e-a24f-45e1-b61f-5efe2c0e11cd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:29.256432 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-1881592e-a24f-45e1-b61f-5efe2c0e11cd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:29.264419 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1881592e-a24f-45e1-b61f-5efe2c0e11cd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:29.264891 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1881592e-a24f-45e1-b61f-5efe2c0e11cd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:29.265692 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1881592e-a24f-45e1-b61f-5efe2c0e11cd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:29.266133 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1881592e-a24f-45e1-b61f-5efe2c0e11cd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:29.382830 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-5e992e01-c9c4-4eb9-ae9a-96efcb910a8f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:29.384465 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-5e992e01-c9c4-4eb9-ae9a-96efcb910a8f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:29.391397 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5e992e01-c9c4-4eb9-ae9a-96efcb910a8f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:29.391878 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5e992e01-c9c4-4eb9-ae9a-96efcb910a8f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:29.392656 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5e992e01-c9c4-4eb9-ae9a-96efcb910a8f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:29.393091 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5e992e01-c9c4-4eb9-ae9a-96efcb910a8f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:29.408225 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1881592e-a24f-45e1-b61f-5efe2c0e11cd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:29.416959 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1881592e-a24f-45e1-b61f-5efe2c0e11cd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:29.418581 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1881592e-a24f-45e1-b61f-5efe2c0e11cd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:29.419904 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1881592e-a24f-45e1-b61f-5efe2c0e11cd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.167791 Dec 20 09:35:29.420608 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 568/1095] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:29 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:35:30.437775 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e5c45fec-c313-4c95-9df9-49b348d3409b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:30.438363 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e5c45fec-c313-4c95-9df9-49b348d3409b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:30.444676 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e5c45fec-c313-4c95-9df9-49b348d3409b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:30.445127 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e5c45fec-c313-4c95-9df9-49b348d3409b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:30.445908 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e5c45fec-c313-4c95-9df9-49b348d3409b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:30.446354 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e5c45fec-c313-4c95-9df9-49b348d3409b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:30.572372 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e5c45fec-c313-4c95-9df9-49b348d3409b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:30.580500 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e5c45fec-c313-4c95-9df9-49b348d3409b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:30.581988 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e5c45fec-c313-4c95-9df9-49b348d3409b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:30.583145 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e5c45fec-c313-4c95-9df9-49b348d3409b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.149130 Dec 20 09:35:30.583720 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 569/1096] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:30 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:35:31.601394 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-19e32a10-6140-495d-a5f1-6440fd1ad28c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:31.602026 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-19e32a10-6140-495d-a5f1-6440fd1ad28c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:31.608803 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-19e32a10-6140-495d-a5f1-6440fd1ad28c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:31.609254 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-19e32a10-6140-495d-a5f1-6440fd1ad28c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:31.610034 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-19e32a10-6140-495d-a5f1-6440fd1ad28c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:31.610476 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-19e32a10-6140-495d-a5f1-6440fd1ad28c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:31.745293 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-19e32a10-6140-495d-a5f1-6440fd1ad28c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:31.753532 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-19e32a10-6140-495d-a5f1-6440fd1ad28c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:31.755030 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-19e32a10-6140-495d-a5f1-6440fd1ad28c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:31.757524 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-19e32a10-6140-495d-a5f1-6440fd1ad28c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.158756 Dec 20 09:35:31.757524 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 570/1097] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:31 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:35:32.773968 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-483e0145-3fcb-47f8-86a1-41199a715c6e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:32.775139 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-483e0145-3fcb-47f8-86a1-41199a715c6e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:32.781703 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-483e0145-3fcb-47f8-86a1-41199a715c6e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:32.782230 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-483e0145-3fcb-47f8-86a1-41199a715c6e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:32.783029 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-483e0145-3fcb-47f8-86a1-41199a715c6e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:32.783480 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-483e0145-3fcb-47f8-86a1-41199a715c6e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:32.916012 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-483e0145-3fcb-47f8-86a1-41199a715c6e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:32.924321 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-483e0145-3fcb-47f8-86a1-41199a715c6e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:32.925823 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-483e0145-3fcb-47f8-86a1-41199a715c6e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:32.926983 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-483e0145-3fcb-47f8-86a1-41199a715c6e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1808 microversion: 2.20 time: 0.156778 Dec 20 09:35:32.927546 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 571/1098] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:32 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:35:33.441767 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-5e992e01-c9c4-4eb9-ae9a-96efcb910a8f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 4.062817 Dec 20 09:35:33.443116 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 528/1099] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:29 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 4065 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 09:35:33.944312 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3bfd1519-b0ab-4616-8e77-350679d07b93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:35:33.944922 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-3bfd1519-b0ab-4616-8e77-350679d07b93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:33.951198 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3bfd1519-b0ab-4616-8e77-350679d07b93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:33.951710 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3bfd1519-b0ab-4616-8e77-350679d07b93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:33.952498 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3bfd1519-b0ab-4616-8e77-350679d07b93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:33.952935 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3bfd1519-b0ab-4616-8e77-350679d07b93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:34.080470 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3bfd1519-b0ab-4616-8e77-350679d07b93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:34.089590 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3bfd1519-b0ab-4616-8e77-350679d07b93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:34.091088 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3bfd1519-b0ab-4616-8e77-350679d07b93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:35:34.092307 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3bfd1519-b0ab-4616-8e77-350679d07b93 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1795 microversion: 2.20 time: 0.151708 Dec 20 09:35:34.092859 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 572/1100] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:35:33 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1795 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:35:34.453791 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ba5f7104-e928-4e67-a794-5209fd0fdbb9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:34.454779 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ba5f7104-e928-4e67-a794-5209fd0fdbb9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:34.461473 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ba5f7104-e928-4e67-a794-5209fd0fdbb9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:34.462577 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ba5f7104-e928-4e67-a794-5209fd0fdbb9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:34.463347 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ba5f7104-e928-4e67-a794-5209fd0fdbb9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:34.463805 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ba5f7104-e928-4e67-a794-5209fd0fdbb9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:34.534807 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ba5f7104-e928-4e67-a794-5209fd0fdbb9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.084872 Dec 20 09:35:34.535435 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 529/1101] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:34 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:35.546415 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8b36e3e9-0112-48b4-91f2-2c5fac397f2a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:35.547352 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-8b36e3e9-0112-48b4-91f2-2c5fac397f2a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:35.553616 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8b36e3e9-0112-48b4-91f2-2c5fac397f2a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:35.554073 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8b36e3e9-0112-48b4-91f2-2c5fac397f2a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:35.554861 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8b36e3e9-0112-48b4-91f2-2c5fac397f2a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:35.555360 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8b36e3e9-0112-48b4-91f2-2c5fac397f2a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:35.622047 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8b36e3e9-0112-48b4-91f2-2c5fac397f2a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.079117 Dec 20 09:35:35.622728 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 573/1102] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:35 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:36.634378 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-169f2426-a6c7-4113-9ba0-a2b45b04304e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:36.635294 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-169f2426-a6c7-4113-9ba0-a2b45b04304e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:36.642022 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-169f2426-a6c7-4113-9ba0-a2b45b04304e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:36.642464 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-169f2426-a6c7-4113-9ba0-a2b45b04304e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:36.643223 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-169f2426-a6c7-4113-9ba0-a2b45b04304e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:36.643652 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-169f2426-a6c7-4113-9ba0-a2b45b04304e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:36.713009 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-169f2426-a6c7-4113-9ba0-a2b45b04304e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.082442 Dec 20 09:35:36.713632 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 530/1103] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:36 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:37.725609 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4046f348-593c-4bd2-b1aa-8b511dca0667 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:37.726580 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-4046f348-593c-4bd2-b1aa-8b511dca0667 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:37.733648 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4046f348-593c-4bd2-b1aa-8b511dca0667 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:37.734753 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4046f348-593c-4bd2-b1aa-8b511dca0667 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:37.734919 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4046f348-593c-4bd2-b1aa-8b511dca0667 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:37.735363 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4046f348-593c-4bd2-b1aa-8b511dca0667 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:37.806420 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-4046f348-593c-4bd2-b1aa-8b511dca0667 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.084475 Dec 20 09:35:37.809282 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 574/1104] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:37 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:38.818773 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-81d3e1dc-d732-4caf-b97a-2515b8b48060 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:38.819882 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-81d3e1dc-d732-4caf-b97a-2515b8b48060 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:38.826813 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-81d3e1dc-d732-4caf-b97a-2515b8b48060 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:38.828843 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-81d3e1dc-d732-4caf-b97a-2515b8b48060 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:38.828843 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-81d3e1dc-d732-4caf-b97a-2515b8b48060 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:38.828843 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-81d3e1dc-d732-4caf-b97a-2515b8b48060 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:38.914586 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-81d3e1dc-d732-4caf-b97a-2515b8b48060 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.099738 Dec 20 09:35:38.915509 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 531/1105] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:38 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:39.926686 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-40aca8e0-5b5b-43bd-90a8-5f08539b01e2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:39.927647 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-40aca8e0-5b5b-43bd-90a8-5f08539b01e2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:39.934866 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-40aca8e0-5b5b-43bd-90a8-5f08539b01e2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:39.935316 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-40aca8e0-5b5b-43bd-90a8-5f08539b01e2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:39.936136 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-40aca8e0-5b5b-43bd-90a8-5f08539b01e2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:39.936581 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-40aca8e0-5b5b-43bd-90a8-5f08539b01e2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:40.011563 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-40aca8e0-5b5b-43bd-90a8-5f08539b01e2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.088882 Dec 20 09:35:40.012457 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 575/1106] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:39 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:41.022931 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-13406e92-8f82-45b5-adf1-23c610ef30fd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:41.023882 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-13406e92-8f82-45b5-adf1-23c610ef30fd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:41.031111 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-13406e92-8f82-45b5-adf1-23c610ef30fd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:41.031548 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-13406e92-8f82-45b5-adf1-23c610ef30fd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:41.032357 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-13406e92-8f82-45b5-adf1-23c610ef30fd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:41.032782 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-13406e92-8f82-45b5-adf1-23c610ef30fd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:41.125384 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-13406e92-8f82-45b5-adf1-23c610ef30fd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.106419 Dec 20 09:35:41.126806 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 532/1107] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:41 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 09:35:42.137675 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-75336a71-08a9-452d-bf8e-90a307f20007 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:42.138752 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-75336a71-08a9-452d-bf8e-90a307f20007 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:42.145804 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-75336a71-08a9-452d-bf8e-90a307f20007 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:42.146250 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-75336a71-08a9-452d-bf8e-90a307f20007 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:42.147032 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-75336a71-08a9-452d-bf8e-90a307f20007 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:42.147472 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-75336a71-08a9-452d-bf8e-90a307f20007 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:45.421745 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-75336a71-08a9-452d-bf8e-90a307f20007 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 3.288021 Dec 20 09:35:45.423121 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 576/1108] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:42 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 3290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:46.434241 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-16a995e5-d5a8-4c9a-bd30-7e1339016d5f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:46.435261 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-16a995e5-d5a8-4c9a-bd30-7e1339016d5f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:46.442085 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-16a995e5-d5a8-4c9a-bd30-7e1339016d5f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:46.442610 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-16a995e5-d5a8-4c9a-bd30-7e1339016d5f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:46.443327 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-16a995e5-d5a8-4c9a-bd30-7e1339016d5f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:46.443794 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-16a995e5-d5a8-4c9a-bd30-7e1339016d5f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:46.506609 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-16a995e5-d5a8-4c9a-bd30-7e1339016d5f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.074931 Dec 20 09:35:46.507286 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 533/1109] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:46 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:47.518782 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a18d5ccb-e7a9-482e-b8e5-2acbcdf39866 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:47.519688 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a18d5ccb-e7a9-482e-b8e5-2acbcdf39866 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:47.527215 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a18d5ccb-e7a9-482e-b8e5-2acbcdf39866 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:47.527671 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a18d5ccb-e7a9-482e-b8e5-2acbcdf39866 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:47.528449 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a18d5ccb-e7a9-482e-b8e5-2acbcdf39866 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:47.528881 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a18d5ccb-e7a9-482e-b8e5-2acbcdf39866 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:47.592817 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a18d5ccb-e7a9-482e-b8e5-2acbcdf39866 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.077968 Dec 20 09:35:47.593474 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 577/1110] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:47 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:48.605501 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a4cb8f5b-9516-44de-b8c1-8c8724b51045 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:48.606412 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a4cb8f5b-9516-44de-b8c1-8c8724b51045 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:48.613231 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a4cb8f5b-9516-44de-b8c1-8c8724b51045 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:48.613652 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a4cb8f5b-9516-44de-b8c1-8c8724b51045 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:48.614407 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a4cb8f5b-9516-44de-b8c1-8c8724b51045 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:48.614835 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a4cb8f5b-9516-44de-b8c1-8c8724b51045 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:48.692192 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a4cb8f5b-9516-44de-b8c1-8c8724b51045 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.091162 Dec 20 09:35:48.692821 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 534/1111] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:48 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:49.704994 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-73c0c6eb-7b8e-451a-a91a-b0920c39d8de tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:49.705923 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-73c0c6eb-7b8e-451a-a91a-b0920c39d8de tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:49.713447 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-73c0c6eb-7b8e-451a-a91a-b0920c39d8de tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:49.713900 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-73c0c6eb-7b8e-451a-a91a-b0920c39d8de tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:49.714680 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-73c0c6eb-7b8e-451a-a91a-b0920c39d8de tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:49.715120 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-73c0c6eb-7b8e-451a-a91a-b0920c39d8de tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:49.788749 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-73c0c6eb-7b8e-451a-a91a-b0920c39d8de tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.087806 Dec 20 09:35:49.789386 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 578/1112] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:49 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:50.800614 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2c7f55d3-b745-4d09-90e1-d9f5e0db9578 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:50.801539 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2c7f55d3-b745-4d09-90e1-d9f5e0db9578 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:50.808463 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2c7f55d3-b745-4d09-90e1-d9f5e0db9578 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:50.808913 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2c7f55d3-b745-4d09-90e1-d9f5e0db9578 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:50.809685 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2c7f55d3-b745-4d09-90e1-d9f5e0db9578 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:50.810123 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2c7f55d3-b745-4d09-90e1-d9f5e0db9578 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:50.874536 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2c7f55d3-b745-4d09-90e1-d9f5e0db9578 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.077951 Dec 20 09:35:50.875208 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 535/1113] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:50 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 09:35:51.887088 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-247e7d4e-50ac-43b5-844b-7a3ef82e5765 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:51.888153 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-247e7d4e-50ac-43b5-844b-7a3ef82e5765 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:51.895032 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-247e7d4e-50ac-43b5-844b-7a3ef82e5765 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:51.895483 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-247e7d4e-50ac-43b5-844b-7a3ef82e5765 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:51.896375 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-247e7d4e-50ac-43b5-844b-7a3ef82e5765 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:51.896818 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-247e7d4e-50ac-43b5-844b-7a3ef82e5765 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:51.965279 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-247e7d4e-50ac-43b5-844b-7a3ef82e5765 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.082683 Dec 20 09:35:51.965907 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 579/1114] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:51 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:52.977358 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-10d91d57-adc8-4ea0-a713-a059a7511ede tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:52.978358 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-10d91d57-adc8-4ea0-a713-a059a7511ede tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:52.985508 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-10d91d57-adc8-4ea0-a713-a059a7511ede tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:52.985955 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-10d91d57-adc8-4ea0-a713-a059a7511ede tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:52.986722 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-10d91d57-adc8-4ea0-a713-a059a7511ede tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:52.987159 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-10d91d57-adc8-4ea0-a713-a059a7511ede tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:53.051213 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-10d91d57-adc8-4ea0-a713-a059a7511ede tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.077744 Dec 20 09:35:53.051861 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 536/1115] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:52 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:54.063931 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9c2e00a9-76a7-40ba-b446-77f954be8981 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:54.064846 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9c2e00a9-76a7-40ba-b446-77f954be8981 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:54.072073 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9c2e00a9-76a7-40ba-b446-77f954be8981 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:54.072517 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9c2e00a9-76a7-40ba-b446-77f954be8981 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:54.073313 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9c2e00a9-76a7-40ba-b446-77f954be8981 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:54.073769 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9c2e00a9-76a7-40ba-b446-77f954be8981 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:54.143680 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9c2e00a9-76a7-40ba-b446-77f954be8981 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.083756 Dec 20 09:35:54.144618 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 580/1116] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:54 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:55.155507 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c315fa97-f702-42bd-b4c9-e252c737de39 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:55.156560 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c315fa97-f702-42bd-b4c9-e252c737de39 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:55.163428 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c315fa97-f702-42bd-b4c9-e252c737de39 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:55.163902 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c315fa97-f702-42bd-b4c9-e252c737de39 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:55.165253 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c315fa97-f702-42bd-b4c9-e252c737de39 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:55.165693 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c315fa97-f702-42bd-b4c9-e252c737de39 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:55.226320 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c315fa97-f702-42bd-b4c9-e252c737de39 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.074564 Dec 20 09:35:55.227737 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 537/1117] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:55 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:56.238745 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0827aa60-2c8d-4c9a-bc67-3ad1ab924dec tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:56.239774 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0827aa60-2c8d-4c9a-bc67-3ad1ab924dec tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:56.247415 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0827aa60-2c8d-4c9a-bc67-3ad1ab924dec tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:56.247893 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0827aa60-2c8d-4c9a-bc67-3ad1ab924dec tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:56.248672 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0827aa60-2c8d-4c9a-bc67-3ad1ab924dec tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:56.249115 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0827aa60-2c8d-4c9a-bc67-3ad1ab924dec tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:56.311123 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0827aa60-2c8d-4c9a-bc67-3ad1ab924dec tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.076204 Dec 20 09:35:56.312173 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 581/1118] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:56 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:57.323471 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-3f8818dc-45d7-42a4-b42a-3c4b34509dbd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:57.324456 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-3f8818dc-45d7-42a4-b42a-3c4b34509dbd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:57.331265 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3f8818dc-45d7-42a4-b42a-3c4b34509dbd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:57.331750 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3f8818dc-45d7-42a4-b42a-3c4b34509dbd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:57.332525 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3f8818dc-45d7-42a4-b42a-3c4b34509dbd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:57.333079 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3f8818dc-45d7-42a4-b42a-3c4b34509dbd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:57.394453 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-3f8818dc-45d7-42a4-b42a-3c4b34509dbd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.075775 Dec 20 09:35:57.395081 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 538/1119] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:57 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:58.406557 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-92ee2fc7-b7f2-4710-9172-0fee9bf6e6b8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:58.407477 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-92ee2fc7-b7f2-4710-9172-0fee9bf6e6b8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:58.415048 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-92ee2fc7-b7f2-4710-9172-0fee9bf6e6b8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:58.415502 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-92ee2fc7-b7f2-4710-9172-0fee9bf6e6b8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:58.416336 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-92ee2fc7-b7f2-4710-9172-0fee9bf6e6b8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:58.416755 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-92ee2fc7-b7f2-4710-9172-0fee9bf6e6b8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:58.479174 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-92ee2fc7-b7f2-4710-9172-0fee9bf6e6b8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.076567 Dec 20 09:35:58.479751 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 582/1120] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:58 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:35:59.494096 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-96e25fcd-59dc-4783-a3a6-1df13dbc9ebb tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:35:59.495383 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-96e25fcd-59dc-4783-a3a6-1df13dbc9ebb tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:35:59.502402 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-96e25fcd-59dc-4783-a3a6-1df13dbc9ebb tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:59.502854 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-96e25fcd-59dc-4783-a3a6-1df13dbc9ebb tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:59.503784 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-96e25fcd-59dc-4783-a3a6-1df13dbc9ebb tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:35:59.504228 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-96e25fcd-59dc-4783-a3a6-1df13dbc9ebb tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:35:59.564465 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-96e25fcd-59dc-4783-a3a6-1df13dbc9ebb tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.076999 Dec 20 09:35:59.565042 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 539/1121] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:35:59 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:00.576822 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1a5e75c0-60ed-4230-9dfa-f4ac85accd53 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:00.577758 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-1a5e75c0-60ed-4230-9dfa-f4ac85accd53 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:00.584467 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1a5e75c0-60ed-4230-9dfa-f4ac85accd53 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:00.584910 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1a5e75c0-60ed-4230-9dfa-f4ac85accd53 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:00.586217 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1a5e75c0-60ed-4230-9dfa-f4ac85accd53 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:00.586650 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1a5e75c0-60ed-4230-9dfa-f4ac85accd53 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:00.649885 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1a5e75c0-60ed-4230-9dfa-f4ac85accd53 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.076984 Dec 20 09:36:00.653759 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 583/1122] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:00 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 09:36:01.665388 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ec9d4bfe-c986-4bbe-a2f7-15c77b1c9ac1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:01.666398 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ec9d4bfe-c986-4bbe-a2f7-15c77b1c9ac1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:01.673613 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ec9d4bfe-c986-4bbe-a2f7-15c77b1c9ac1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:01.674121 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ec9d4bfe-c986-4bbe-a2f7-15c77b1c9ac1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:01.674996 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ec9d4bfe-c986-4bbe-a2f7-15c77b1c9ac1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:01.675436 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ec9d4bfe-c986-4bbe-a2f7-15c77b1c9ac1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:01.744333 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ec9d4bfe-c986-4bbe-a2f7-15c77b1c9ac1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.086006 Dec 20 09:36:01.744814 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 540/1123] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:01 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:02.755378 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-db8e6913-52be-41f3-9d75-8af107f53cff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:02.757048 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-db8e6913-52be-41f3-9d75-8af107f53cff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:02.763948 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-db8e6913-52be-41f3-9d75-8af107f53cff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:02.764608 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-db8e6913-52be-41f3-9d75-8af107f53cff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:02.765411 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-db8e6913-52be-41f3-9d75-8af107f53cff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:02.765848 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-db8e6913-52be-41f3-9d75-8af107f53cff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:02.842732 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-db8e6913-52be-41f3-9d75-8af107f53cff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.091009 Dec 20 09:36:02.845895 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 584/1124] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:02 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:03.857823 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b97a3855-17b6-4a07-a454-e80a217da850 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:03.858823 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b97a3855-17b6-4a07-a454-e80a217da850 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:03.865827 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b97a3855-17b6-4a07-a454-e80a217da850 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:03.866335 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b97a3855-17b6-4a07-a454-e80a217da850 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:03.867767 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b97a3855-17b6-4a07-a454-e80a217da850 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:03.868225 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b97a3855-17b6-4a07-a454-e80a217da850 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:04.085263 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b97a3855-17b6-4a07-a454-e80a217da850 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.231248 Dec 20 09:36:04.087751 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 541/1125] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:03 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:05.104183 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-71b40f35-0f4b-44c1-870a-0c557c48869b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:05.105877 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-71b40f35-0f4b-44c1-870a-0c557c48869b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:05.113508 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-71b40f35-0f4b-44c1-870a-0c557c48869b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:05.114216 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-71b40f35-0f4b-44c1-870a-0c557c48869b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:05.115062 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-71b40f35-0f4b-44c1-870a-0c557c48869b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:05.115504 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-71b40f35-0f4b-44c1-870a-0c557c48869b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:05.182118 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-71b40f35-0f4b-44c1-870a-0c557c48869b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.084625 Dec 20 09:36:05.182786 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 585/1126] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:05 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:06.194795 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-029aff0b-7605-4674-8ef2-5a01db111471 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:06.195866 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-029aff0b-7605-4674-8ef2-5a01db111471 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:06.203881 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-029aff0b-7605-4674-8ef2-5a01db111471 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:06.204519 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-029aff0b-7605-4674-8ef2-5a01db111471 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:06.206381 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-029aff0b-7605-4674-8ef2-5a01db111471 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:06.207176 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-029aff0b-7605-4674-8ef2-5a01db111471 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:06.276899 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-029aff0b-7605-4674-8ef2-5a01db111471 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.086168 Dec 20 09:36:06.281603 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 542/1127] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:06 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:07.293422 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9f724b8f-caf1-4996-8aec-b572bccc87cd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:07.294501 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9f724b8f-caf1-4996-8aec-b572bccc87cd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:07.308097 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9f724b8f-caf1-4996-8aec-b572bccc87cd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:07.308097 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9f724b8f-caf1-4996-8aec-b572bccc87cd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:07.310453 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9f724b8f-caf1-4996-8aec-b572bccc87cd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:07.310911 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9f724b8f-caf1-4996-8aec-b572bccc87cd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:07.405743 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9f724b8f-caf1-4996-8aec-b572bccc87cd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.116316 Dec 20 09:36:07.406336 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 586/1128] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:07 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:08.423368 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-50c8eefc-0c33-4d96-ac0f-abd7c1bd7b1a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:08.427050 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-50c8eefc-0c33-4d96-ac0f-abd7c1bd7b1a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:08.446455 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-50c8eefc-0c33-4d96-ac0f-abd7c1bd7b1a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:08.462951 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-50c8eefc-0c33-4d96-ac0f-abd7c1bd7b1a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:08.464069 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-50c8eefc-0c33-4d96-ac0f-abd7c1bd7b1a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:08.464513 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-50c8eefc-0c33-4d96-ac0f-abd7c1bd7b1a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:08.566322 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-50c8eefc-0c33-4d96-ac0f-abd7c1bd7b1a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.151395 Dec 20 09:36:08.567192 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 543/1129] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:08 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:09.578528 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-796d03f7-95dc-43cc-9248-1ead33dbb71c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:09.583704 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-796d03f7-95dc-43cc-9248-1ead33dbb71c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:09.591196 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-796d03f7-95dc-43cc-9248-1ead33dbb71c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:09.591905 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-796d03f7-95dc-43cc-9248-1ead33dbb71c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:09.592701 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-796d03f7-95dc-43cc-9248-1ead33dbb71c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:09.593133 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-796d03f7-95dc-43cc-9248-1ead33dbb71c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:09.668326 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-796d03f7-95dc-43cc-9248-1ead33dbb71c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.093740 Dec 20 09:36:09.669949 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 587/1130] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:09 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:10.683566 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-21063051-33a0-47a4-acf8-9faf4b30eb3f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:10.685431 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-21063051-33a0-47a4-acf8-9faf4b30eb3f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:10.693966 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-21063051-33a0-47a4-acf8-9faf4b30eb3f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:10.694579 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-21063051-33a0-47a4-acf8-9faf4b30eb3f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:10.700398 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-21063051-33a0-47a4-acf8-9faf4b30eb3f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:10.700398 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-21063051-33a0-47a4-acf8-9faf4b30eb3f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:10.757257 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-21063051-33a0-47a4-acf8-9faf4b30eb3f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.079918 Dec 20 09:36:10.758160 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 544/1131] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:10 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:10.960741 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7a96d2b9-28c5-4ea8-991d-89c644847b6a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Action: 'create', calling method: .version_select at 0x7f914e2fab80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1875582186"}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:10.975845 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-7a96d2b9-28c5-4ea8-991d-89c644847b6a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Getting quotas for project 3273ceb50413452bb9e132e4a98437b1. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:36:10.987434 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-7a96d2b9-28c5-4ea8-991d-89c644847b6a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Getting quotas for user e427653540434b0abbea7950c81e4b1b and project 3273ceb50413452bb9e132e4a98437b1. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:36:10.995867 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7a96d2b9-28c5-4ea8-991d-89c644847b6a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [e7b09ccc-7ab8-4505-89f4-28e399646a42] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 20 09:36:11.769557 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-82b38655-06b1-497d-b9ac-0d3ea049f285 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:11.770561 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-82b38655-06b1-497d-b9ac-0d3ea049f285 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:11.777809 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-82b38655-06b1-497d-b9ac-0d3ea049f285 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:11.778257 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-82b38655-06b1-497d-b9ac-0d3ea049f285 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:11.779112 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-82b38655-06b1-497d-b9ac-0d3ea049f285 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:11.779553 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-82b38655-06b1-497d-b9ac-0d3ea049f285 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:11.849978 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-82b38655-06b1-497d-b9ac-0d3ea049f285 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.084374 Dec 20 09:36:11.850625 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 545/1132] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:11 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 09:36:12.002738 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO oslo.messaging._drivers.impl_rabbit [None req-7a96d2b9-28c5-4ea8-991d-89c644847b6a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [e7b09ccc-7ab8-4505-89f4-28e399646a42] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 37322. Dec 20 09:36:12.596608 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-7a96d2b9-28c5-4ea8-991d-89c644847b6a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Getting quotas for project 3273ceb50413452bb9e132e4a98437b1. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:36:12.600536 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-7a96d2b9-28c5-4ea8-991d-89c644847b6a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Getting quotas for user e427653540434b0abbea7950c81e4b1b and project 3273ceb50413452bb9e132e4a98437b1. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:36:12.614591 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7a96d2b9-28c5-4ea8-991d-89c644847b6a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 1.820870 Dec 20 09:36:12.615192 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 588/1133] 10.222.0.62 () {60 vars in 1157 bytes} [Mon Dec 20 09:36:10 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:36:12.862702 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2a15dc2f-bd13-4ce8-93c7-18f6313e026a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:12.863836 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2a15dc2f-bd13-4ce8-93c7-18f6313e026a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:12.871112 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2a15dc2f-bd13-4ce8-93c7-18f6313e026a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:12.871732 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2a15dc2f-bd13-4ce8-93c7-18f6313e026a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:12.872580 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2a15dc2f-bd13-4ce8-93c7-18f6313e026a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:12.873258 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2a15dc2f-bd13-4ce8-93c7-18f6313e026a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:12.937166 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2a15dc2f-bd13-4ce8-93c7-18f6313e026a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.078182 Dec 20 09:36:12.938249 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 546/1134] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:12 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:13.949590 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e6c804bd-adf5-441a-afeb-a2386cad6e28 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:13.950775 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e6c804bd-adf5-441a-afeb-a2386cad6e28 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:13.959875 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e6c804bd-adf5-441a-afeb-a2386cad6e28 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:13.962693 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e6c804bd-adf5-441a-afeb-a2386cad6e28 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:13.962693 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e6c804bd-adf5-441a-afeb-a2386cad6e28 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:13.963499 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e6c804bd-adf5-441a-afeb-a2386cad6e28 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:14.050254 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e6c804bd-adf5-441a-afeb-a2386cad6e28 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.104478 Dec 20 09:36:14.054557 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 589/1135] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:13 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 09:36:15.063076 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-99496a9b-63ce-4cb0-b6ca-335e33c24d93 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:15.064220 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-99496a9b-63ce-4cb0-b6ca-335e33c24d93 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:15.071175 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-99496a9b-63ce-4cb0-b6ca-335e33c24d93 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:15.071625 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-99496a9b-63ce-4cb0-b6ca-335e33c24d93 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:15.072609 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-99496a9b-63ce-4cb0-b6ca-335e33c24d93 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:15.073049 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-99496a9b-63ce-4cb0-b6ca-335e33c24d93 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:15.141227 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-99496a9b-63ce-4cb0-b6ca-335e33c24d93 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.082300 Dec 20 09:36:15.142715 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 547/1136] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:15 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:16.153420 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-18cbbdce-30d6-441b-9b8e-7625f7beb055 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:16.154461 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-18cbbdce-30d6-441b-9b8e-7625f7beb055 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:16.161842 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-18cbbdce-30d6-441b-9b8e-7625f7beb055 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:16.162298 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-18cbbdce-30d6-441b-9b8e-7625f7beb055 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:16.163729 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-18cbbdce-30d6-441b-9b8e-7625f7beb055 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:16.163875 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-18cbbdce-30d6-441b-9b8e-7625f7beb055 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:16.240886 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-18cbbdce-30d6-441b-9b8e-7625f7beb055 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.091266 Dec 20 09:36:16.241451 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 590/1137] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:16 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:17.256759 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c0671415-a7ed-473d-8180-73761113766d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:17.258545 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c0671415-a7ed-473d-8180-73761113766d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:17.268712 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c0671415-a7ed-473d-8180-73761113766d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:17.269156 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c0671415-a7ed-473d-8180-73761113766d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:17.269931 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c0671415-a7ed-473d-8180-73761113766d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:17.270356 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c0671415-a7ed-473d-8180-73761113766d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:17.338169 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c0671415-a7ed-473d-8180-73761113766d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29729 microversion: 2.1 time: 0.088245 Dec 20 09:36:17.338733 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 548/1138] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:17 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29729 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:18.350385 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c17d4338-106d-4473-898d-57e0c791d127 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:18.351307 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c17d4338-106d-4473-898d-57e0c791d127 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:18.359735 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c17d4338-106d-4473-898d-57e0c791d127 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:18.360192 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c17d4338-106d-4473-898d-57e0c791d127 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:18.360991 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c17d4338-106d-4473-898d-57e0c791d127 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:18.361439 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c17d4338-106d-4473-898d-57e0c791d127 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:18.457816 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c17d4338-106d-4473-898d-57e0c791d127 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 29866 microversion: 2.1 time: 0.111461 Dec 20 09:36:18.458485 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 591/1139] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:18 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 29866 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:19.469677 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-83fcfe5c-a825-4de3-8753-4d32ae757240 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:19.470688 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-83fcfe5c-a825-4de3-8753-4d32ae757240 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:19.477775 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-83fcfe5c-a825-4de3-8753-4d32ae757240 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:19.478227 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-83fcfe5c-a825-4de3-8753-4d32ae757240 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:19.479088 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-83fcfe5c-a825-4de3-8753-4d32ae757240 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:19.479535 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-83fcfe5c-a825-4de3-8753-4d32ae757240 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:19.571492 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-83fcfe5c-a825-4de3-8753-4d32ae757240 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 31592 microversion: 2.1 time: 0.105604 Dec 20 09:36:19.573062 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 549/1140] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:19 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 31592 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:20.584434 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9c187563-5f01-41a2-ac5b-1164a3505df1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:20.585542 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9c187563-5f01-41a2-ac5b-1164a3505df1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:20.593629 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9c187563-5f01-41a2-ac5b-1164a3505df1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:20.594100 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9c187563-5f01-41a2-ac5b-1164a3505df1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:20.594884 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9c187563-5f01-41a2-ac5b-1164a3505df1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:20.595314 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9c187563-5f01-41a2-ac5b-1164a3505df1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:20.674425 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9c187563-5f01-41a2-ac5b-1164a3505df1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 33108 microversion: 2.1 time: 0.094044 Dec 20 09:36:20.675117 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 592/1141] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:20 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 33108 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:21.687435 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e872555f-3494-4037-b6cb-936c6e4dbb0e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:21.689868 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e872555f-3494-4037-b6cb-936c6e4dbb0e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:21.696252 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e872555f-3494-4037-b6cb-936c6e4dbb0e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:21.696697 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e872555f-3494-4037-b6cb-936c6e4dbb0e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:21.697471 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e872555f-3494-4037-b6cb-936c6e4dbb0e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:21.697899 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e872555f-3494-4037-b6cb-936c6e4dbb0e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:21.788455 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e872555f-3494-4037-b6cb-936c6e4dbb0e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 34310 microversion: 2.1 time: 0.104878 Dec 20 09:36:21.789329 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 550/1142] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:21 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 34310 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:22.801404 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-444e327f-9ebe-4393-a816-fa65abedc95f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:22.802405 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-444e327f-9ebe-4393-a816-fa65abedc95f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:22.809314 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-444e327f-9ebe-4393-a816-fa65abedc95f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:22.809761 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-444e327f-9ebe-4393-a816-fa65abedc95f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:22.810532 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-444e327f-9ebe-4393-a816-fa65abedc95f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:22.810969 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-444e327f-9ebe-4393-a816-fa65abedc95f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:22.888998 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-444e327f-9ebe-4393-a816-fa65abedc95f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 34940 microversion: 2.1 time: 0.091434 Dec 20 09:36:22.889663 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 593/1143] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:22 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 34940 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:23.901372 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2ef346b2-dec4-4bca-9413-0bb8a5365f17 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:23.902435 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2ef346b2-dec4-4bca-9413-0bb8a5365f17 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:23.909216 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2ef346b2-dec4-4bca-9413-0bb8a5365f17 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:23.909663 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2ef346b2-dec4-4bca-9413-0bb8a5365f17 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:23.910428 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2ef346b2-dec4-4bca-9413-0bb8a5365f17 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:23.910862 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2ef346b2-dec4-4bca-9413-0bb8a5365f17 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:23.991271 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2ef346b2-dec4-4bca-9413-0bb8a5365f17 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 36002 microversion: 2.1 time: 0.093761 Dec 20 09:36:23.991936 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 551/1144] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:23 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 36002 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:25.004455 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f6ab876d-2c2b-4db8-8b22-69b0d9657a22 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:25.005464 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f6ab876d-2c2b-4db8-8b22-69b0d9657a22 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:25.012549 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f6ab876d-2c2b-4db8-8b22-69b0d9657a22 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:25.012998 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f6ab876d-2c2b-4db8-8b22-69b0d9657a22 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:25.013777 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f6ab876d-2c2b-4db8-8b22-69b0d9657a22 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:25.014271 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f6ab876d-2c2b-4db8-8b22-69b0d9657a22 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:25.100790 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f6ab876d-2c2b-4db8-8b22-69b0d9657a22 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 36947 microversion: 2.1 time: 0.100233 Dec 20 09:36:25.101457 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 594/1145] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:24 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 36947 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:26.113074 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-91719d17-13e9-4493-aa64-5b87815583a9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:26.114082 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-91719d17-13e9-4493-aa64-5b87815583a9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:26.121899 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-91719d17-13e9-4493-aa64-5b87815583a9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:26.122350 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-91719d17-13e9-4493-aa64-5b87815583a9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:26.123125 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-91719d17-13e9-4493-aa64-5b87815583a9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:26.123572 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-91719d17-13e9-4493-aa64-5b87815583a9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:26.198248 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-91719d17-13e9-4493-aa64-5b87815583a9 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 38131 microversion: 2.1 time: 0.088947 Dec 20 09:36:26.198896 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 552/1146] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:26 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 38131 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:27.210777 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-bb02f3a5-60c5-4aaf-920b-2a93980f1828 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:27.211813 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-bb02f3a5-60c5-4aaf-920b-2a93980f1828 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:27.219168 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bb02f3a5-60c5-4aaf-920b-2a93980f1828 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:27.219619 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bb02f3a5-60c5-4aaf-920b-2a93980f1828 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:27.220541 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bb02f3a5-60c5-4aaf-920b-2a93980f1828 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:27.220981 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bb02f3a5-60c5-4aaf-920b-2a93980f1828 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:27.301855 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-bb02f3a5-60c5-4aaf-920b-2a93980f1828 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 39253 microversion: 2.1 time: 0.094969 Dec 20 09:36:27.302539 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 595/1147] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:27 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 39253 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:28.316444 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ceb25ae6-f936-4ea3-b632-6b1542d3fec0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:28.316444 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ceb25ae6-f936-4ea3-b632-6b1542d3fec0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:28.326343 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ceb25ae6-f936-4ea3-b632-6b1542d3fec0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:28.326343 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ceb25ae6-f936-4ea3-b632-6b1542d3fec0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:28.326343 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ceb25ae6-f936-4ea3-b632-6b1542d3fec0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:28.326343 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ceb25ae6-f936-4ea3-b632-6b1542d3fec0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:28.396369 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ceb25ae6-f936-4ea3-b632-6b1542d3fec0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 39253 microversion: 2.1 time: 0.085992 Dec 20 09:36:28.397036 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 553/1148] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:28 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 39253 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:29.408720 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d5272d8b-ac60-4b8a-ba29-4416530ce693 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:29.409729 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d5272d8b-ac60-4b8a-ba29-4416530ce693 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:29.416629 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d5272d8b-ac60-4b8a-ba29-4416530ce693 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:29.417081 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d5272d8b-ac60-4b8a-ba29-4416530ce693 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:29.417863 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d5272d8b-ac60-4b8a-ba29-4416530ce693 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:29.418958 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d5272d8b-ac60-4b8a-ba29-4416530ce693 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:29.485772 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d5272d8b-ac60-4b8a-ba29-4416530ce693 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 39253 microversion: 2.1 time: 0.080926 Dec 20 09:36:29.486439 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 596/1149] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:29 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 39253 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:30.498261 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-3ffac249-41fb-4b89-96d9-dd673bab1779 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:30.499270 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-3ffac249-41fb-4b89-96d9-dd673bab1779 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:30.506144 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3ffac249-41fb-4b89-96d9-dd673bab1779 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:30.506603 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3ffac249-41fb-4b89-96d9-dd673bab1779 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:30.507377 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3ffac249-41fb-4b89-96d9-dd673bab1779 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:30.507842 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3ffac249-41fb-4b89-96d9-dd673bab1779 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:30.580036 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-3ffac249-41fb-4b89-96d9-dd673bab1779 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 39253 microversion: 2.1 time: 0.085583 Dec 20 09:36:30.580984 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 554/1150] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:30 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 39253 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:31.592747 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8b759713-8ca9-43bd-9d02-c61626906251 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:31.593747 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-8b759713-8ca9-43bd-9d02-c61626906251 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:31.600663 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8b759713-8ca9-43bd-9d02-c61626906251 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:31.601112 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8b759713-8ca9-43bd-9d02-c61626906251 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:31.601887 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8b759713-8ca9-43bd-9d02-c61626906251 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:31.602325 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8b759713-8ca9-43bd-9d02-c61626906251 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:31.682038 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8b759713-8ca9-43bd-9d02-c61626906251 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 200 len: 39384 microversion: 2.1 time: 0.093627 Dec 20 09:36:31.682908 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 597/1151] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:31 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 39384 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:31.692719 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-7c04fe2c-be80-43e5-8815-5ad83074494d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:31.693322 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-7c04fe2c-be80-43e5-8815-5ad83074494d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:31.700243 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7c04fe2c-be80-43e5-8815-5ad83074494d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:31.702249 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7c04fe2c-be80-43e5-8815-5ad83074494d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:31.702249 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7c04fe2c-be80-43e5-8815-5ad83074494d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:31.702249 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7c04fe2c-be80-43e5-8815-5ad83074494d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:31.725526 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-7c04fe2c-be80-43e5-8815-5ad83074494d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/ips" status: 200 len: 144 microversion: 2.1 time: 0.036844 Dec 20 09:36:31.726091 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 555/1152] 10.222.0.62 () {58 vars in 1247 bytes} [Mon Dec 20 09:36:31 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:36:35.948883 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-97f795a8-dbaa-4ef6-afe6-fce1206738db tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b60c8923-fc70-418f-8129-697336e82de1"}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:35.950561 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-97f795a8-dbaa-4ef6-afe6-fce1206738db tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:35.957053 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-97f795a8-dbaa-4ef6-afe6-fce1206738db tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:35.957505 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-97f795a8-dbaa-4ef6-afe6-fce1206738db tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:35.958286 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-97f795a8-dbaa-4ef6-afe6-fce1206738db tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:35.958725 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-97f795a8-dbaa-4ef6-afe6-fce1206738db tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:36.640263 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-97f795a8-dbaa-4ef6-afe6-fce1206738db tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.695350 Dec 20 09:36:36.640967 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 598/1153] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 20 09:36:35 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/os-volume_attachments => generated 194 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:36:38.411208 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 20 09:36:38.411628 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: Mon Dec 20 09:36:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 20 09:36:44.015991 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2f083340-6657-4d98-b21d-14318972bacc tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-385076375", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1875582186", "security_groups": [{"name": "tempest-secgroup-smoke-1854104214"}], "networks": [{"uuid": "73e80991-a432-4dc2-8c45-d993e1baa408"}], "block_device_mapping_v2": [{"uuid": "02991002-ef21-489b-8720-df704ceb9ce7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:44.131778 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.network.neutron [None req-2f083340-6657-4d98-b21d-14318972bacc tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] validate_networks() for [('73e80991-a432-4dc2-8c45-d993e1baa408', None, None, None, None, None)] {{(pid=116675) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 09:36:44.701816 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-2f083340-6657-4d98-b21d-14318972bacc tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Flavor limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 09:36:44.702292 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-2f083340-6657-4d98-b21d-14318972bacc tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Image limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 09:36:44.702775 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-2f083340-6657-4d98-b21d-14318972bacc tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Flavor pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 09:36:44.703181 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-2f083340-6657-4d98-b21d-14318972bacc tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Image pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 09:36:44.703600 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-2f083340-6657-4d98-b21d-14318972bacc tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 09:36:44.712287 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2f083340-6657-4d98-b21d-14318972bacc tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:44.712738 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2f083340-6657-4d98-b21d-14318972bacc tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:44.713556 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2f083340-6657-4d98-b21d-14318972bacc tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:44.713999 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2f083340-6657-4d98-b21d-14318972bacc tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:44.731183 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-2f083340-6657-4d98-b21d-14318972bacc tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Getting quotas for project 3273ceb50413452bb9e132e4a98437b1. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:36:44.735203 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-2f083340-6657-4d98-b21d-14318972bacc tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Getting quotas for user e427653540434b0abbea7950c81e4b1b and project 3273ceb50413452bb9e132e4a98437b1. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:36:44.788416 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2f083340-6657-4d98-b21d-14318972bacc tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Going to run 1 instances... {{(pid=116675) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 09:36:44.790494 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2f083340-6657-4d98-b21d-14318972bacc tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='02991002-ef21-489b-8720-df704ceb9ce7',volume_size=None,volume_type=None)] {{(pid=116675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 09:36:45.083321 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2f083340-6657-4d98-b21d-14318972bacc tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.071547 Dec 20 09:36:45.088872 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 556/1154] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 20 09:36:44 2021] POST /compute/v2.1/servers => generated 406 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 09:36:45.099901 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-24365fdc-ba9c-4d73-95df-eefd87b60927 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:45.099901 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-24365fdc-ba9c-4d73-95df-eefd87b60927 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:45.157371 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-466938b5-62b2-48d9-baa1-7973eeb5eb9e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:45.158695 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-24365fdc-ba9c-4d73-95df-eefd87b60927 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:45.164430 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-466938b5-62b2-48d9-baa1-7973eeb5eb9e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:45.165084 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-466938b5-62b2-48d9-baa1-7973eeb5eb9e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:45.166938 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-24365fdc-ba9c-4d73-95df-eefd87b60927 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1088 microversion: 2.1 time: 0.076035 Dec 20 09:36:45.167930 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 599/1155] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:45 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1088 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:45.226444 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-466938b5-62b2-48d9-baa1-7973eeb5eb9e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Going to try to stop instance {{(pid=116675) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 20 09:36:45.387688 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-466938b5-62b2-48d9-baa1-7973eeb5eb9e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 202 len: 0 microversion: 2.1 time: 0.234298 Dec 20 09:36:45.392141 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 557/1156] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:45 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:36:45.395982 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f4def3de-9259-4de1-96c4-a95db9ce6f50 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:45.396589 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f4def3de-9259-4de1-96c4-a95db9ce6f50 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:45.404059 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f4def3de-9259-4de1-96c4-a95db9ce6f50 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:45.404516 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f4def3de-9259-4de1-96c4-a95db9ce6f50 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:45.405328 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f4def3de-9259-4de1-96c4-a95db9ce6f50 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:45.405766 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f4def3de-9259-4de1-96c4-a95db9ce6f50 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:45.545802 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f4def3de-9259-4de1-96c4-a95db9ce6f50 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:45.554054 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f4def3de-9259-4de1-96c4-a95db9ce6f50 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1722 microversion: 2.1 time: 0.161650 Dec 20 09:36:45.554637 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 600/1157] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:45 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:46.186416 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b986361c-b6b5-4f0b-ad3f-1018a1af0237 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:46.186977 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b986361c-b6b5-4f0b-ad3f-1018a1af0237 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:46.193365 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b986361c-b6b5-4f0b-ad3f-1018a1af0237 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:46.193922 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b986361c-b6b5-4f0b-ad3f-1018a1af0237 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:46.194771 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b986361c-b6b5-4f0b-ad3f-1018a1af0237 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:46.195342 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b986361c-b6b5-4f0b-ad3f-1018a1af0237 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:46.256735 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b986361c-b6b5-4f0b-ad3f-1018a1af0237 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:46.264121 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b986361c-b6b5-4f0b-ad3f-1018a1af0237 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1138 microversion: 2.1 time: 0.083101 Dec 20 09:36:46.264683 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 558/1158] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:46 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1138 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:46.295903 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-50a274e0-de1b-4cf4-a372-89ee5992b5e2 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:46.300720 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-50a274e0-de1b-4cf4-a372-89ee5992b5e2 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:46.303316 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-50a274e0-de1b-4cf4-a372-89ee5992b5e2 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:46.303803 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-50a274e0-de1b-4cf4-a372-89ee5992b5e2 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:46.304583 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-50a274e0-de1b-4cf4-a372-89ee5992b5e2 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:46.305020 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-50a274e0-de1b-4cf4-a372-89ee5992b5e2 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:46.519775 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-50a274e0-de1b-4cf4-a372-89ee5992b5e2 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "POST /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8/action" status: 202 len: 0 microversion: 2.1 time: 0.227946 Dec 20 09:36:46.520713 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 601/1159] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:36:46 2021] POST /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:36:46.528626 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9330db07-7b9b-404d-b270-04be88bbc012 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:46.529250 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9330db07-7b9b-404d-b270-04be88bbc012 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:46.535082 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9330db07-7b9b-404d-b270-04be88bbc012 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:46.535535 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9330db07-7b9b-404d-b270-04be88bbc012 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:46.536357 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9330db07-7b9b-404d-b270-04be88bbc012 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:46.536792 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9330db07-7b9b-404d-b270-04be88bbc012 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:46.572395 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1c04c942-9584-46b8-87de-e464f79a9c3d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:46.573096 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-1c04c942-9584-46b8-87de-e464f79a9c3d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:46.579227 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1c04c942-9584-46b8-87de-e464f79a9c3d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:46.579695 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1c04c942-9584-46b8-87de-e464f79a9c3d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:46.580482 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1c04c942-9584-46b8-87de-e464f79a9c3d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:46.580925 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1c04c942-9584-46b8-87de-e464f79a9c3d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:46.732166 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-9330db07-7b9b-404d-b270-04be88bbc012 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:46.740892 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9330db07-7b9b-404d-b270-04be88bbc012 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1749 microversion: 2.1 time: 0.215886 Dec 20 09:36:46.741471 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 559/1160] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:46 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1749 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:36:46.768420 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1c04c942-9584-46b8-87de-e464f79a9c3d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:46.776357 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1c04c942-9584-46b8-87de-e464f79a9c3d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1722 microversion: 2.1 time: 0.207957 Dec 20 09:36:46.777177 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 602/1161] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:46 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:36:47.281274 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-cedb19bf-d056-4aa4-8c52-0ccf874b676c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:47.281893 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-cedb19bf-d056-4aa4-8c52-0ccf874b676c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:47.288839 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cedb19bf-d056-4aa4-8c52-0ccf874b676c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:47.288839 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cedb19bf-d056-4aa4-8c52-0ccf874b676c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:47.289826 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cedb19bf-d056-4aa4-8c52-0ccf874b676c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:47.290278 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cedb19bf-d056-4aa4-8c52-0ccf874b676c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:47.355424 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-cedb19bf-d056-4aa4-8c52-0ccf874b676c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:47.362912 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-cedb19bf-d056-4aa4-8c52-0ccf874b676c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1204 microversion: 2.1 time: 0.085985 Dec 20 09:36:47.363475 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 560/1162] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:47 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1204 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:36:47.758344 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-15399494-9755-4fab-a89e-9a399d63d9bc tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:47.758942 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-15399494-9755-4fab-a89e-9a399d63d9bc tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:47.766222 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-15399494-9755-4fab-a89e-9a399d63d9bc tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:47.766671 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-15399494-9755-4fab-a89e-9a399d63d9bc tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:47.767456 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-15399494-9755-4fab-a89e-9a399d63d9bc tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:47.767926 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-15399494-9755-4fab-a89e-9a399d63d9bc tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:47.793562 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6f4cf8aa-73d5-48d4-b0ec-ae9302ec9d88 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:47.794458 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6f4cf8aa-73d5-48d4-b0ec-ae9302ec9d88 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:47.800796 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6f4cf8aa-73d5-48d4-b0ec-ae9302ec9d88 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:47.801196 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6f4cf8aa-73d5-48d4-b0ec-ae9302ec9d88 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:47.801983 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6f4cf8aa-73d5-48d4-b0ec-ae9302ec9d88 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:47.802425 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6f4cf8aa-73d5-48d4-b0ec-ae9302ec9d88 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:47.977578 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-15399494-9755-4fab-a89e-9a399d63d9bc tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:47.985840 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-15399494-9755-4fab-a89e-9a399d63d9bc tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1754 microversion: 2.1 time: 0.231174 Dec 20 09:36:47.986668 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 603/1163] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:47 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1754 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:47.999758 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6f4cf8aa-73d5-48d4-b0ec-ae9302ec9d88 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:48.030278 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6f4cf8aa-73d5-48d4-b0ec-ae9302ec9d88 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1722 microversion: 2.1 time: 0.229511 Dec 20 09:36:48.030278 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 561/1164] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:47 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:36:48.380976 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b8891b22-e66d-470d-af60-015711ffc731 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:48.381737 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b8891b22-e66d-470d-af60-015711ffc731 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:48.388348 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b8891b22-e66d-470d-af60-015711ffc731 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:48.389014 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b8891b22-e66d-470d-af60-015711ffc731 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:48.389876 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b8891b22-e66d-470d-af60-015711ffc731 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:48.390380 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b8891b22-e66d-470d-af60-015711ffc731 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:48.542274 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b8891b22-e66d-470d-af60-015711ffc731 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:48.549871 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b8891b22-e66d-470d-af60-015711ffc731 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1272 microversion: 2.1 time: 0.172805 Dec 20 09:36:48.550451 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 604/1165] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:48 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:36:48.960293 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-2fc43529-b2fe-401e-a3b3-9d8b811203f9 req-f75559df-76eb-4ef3-bc1c-08bb78d2f907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2454a5d-038c-422c-8b61-b88674e18a3c", "tag": "4bfd2d96-5b20-4456-afea-5b3bbf0b1cfe"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:36:48.961898 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:36:48.961898 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:36:48.972583 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-2fc43529-b2fe-401e-a3b3-9d8b811203f9 req-f75559df-76eb-4ef3-bc1c-08bb78d2f907 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:48.973025 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-2fc43529-b2fe-401e-a3b3-9d8b811203f9 req-f75559df-76eb-4ef3-bc1c-08bb78d2f907 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:48.987938 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-2fc43529-b2fe-401e-a3b3-9d8b811203f9 req-f75559df-76eb-4ef3-bc1c-08bb78d2f907 service nova] Creating event network-changed:4bfd2d96-5b20-4456-afea-5b3bbf0b1cfe for instance b2454a5d-038c-422c-8b61-b88674e18a3c on hv-cinder-81908 Dec 20 09:36:48.993304 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-2fc43529-b2fe-401e-a3b3-9d8b811203f9 req-f75559df-76eb-4ef3-bc1c-08bb78d2f907 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036285 Dec 20 09:36:48.994033 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 562/1166] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:36:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:36:49.003215 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-673e26de-bce0-490f-bf13-e46330128bbb tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:49.007387 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-673e26de-bce0-490f-bf13-e46330128bbb tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:49.014879 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-673e26de-bce0-490f-bf13-e46330128bbb tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:49.015433 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-673e26de-bce0-490f-bf13-e46330128bbb tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:49.016263 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-673e26de-bce0-490f-bf13-e46330128bbb tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:49.016750 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-673e26de-bce0-490f-bf13-e46330128bbb tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:49.037675 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4356512d-7011-4d5d-90cd-e0e3e3fd36af tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:49.038435 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4356512d-7011-4d5d-90cd-e0e3e3fd36af tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:49.046042 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4356512d-7011-4d5d-90cd-e0e3e3fd36af tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:49.046782 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4356512d-7011-4d5d-90cd-e0e3e3fd36af tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:49.047765 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4356512d-7011-4d5d-90cd-e0e3e3fd36af tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:49.048354 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4356512d-7011-4d5d-90cd-e0e3e3fd36af tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:49.272937 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-4356512d-7011-4d5d-90cd-e0e3e3fd36af tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:49.279971 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-673e26de-bce0-490f-bf13-e46330128bbb tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:49.287044 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4356512d-7011-4d5d-90cd-e0e3e3fd36af tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1722 microversion: 2.1 time: 0.253439 Dec 20 09:36:49.287754 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 563/1167] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:49 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:49.296565 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-673e26de-bce0-490f-bf13-e46330128bbb tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1754 microversion: 2.1 time: 0.288615 Dec 20 09:36:49.298329 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 605/1168] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:48 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1754 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:49.566189 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-27086c53-f5fe-4451-9cef-79711f8eea3c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:49.566792 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-27086c53-f5fe-4451-9cef-79711f8eea3c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:49.572551 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-27086c53-f5fe-4451-9cef-79711f8eea3c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:49.573134 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-27086c53-f5fe-4451-9cef-79711f8eea3c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:49.573901 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-27086c53-f5fe-4451-9cef-79711f8eea3c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:49.574327 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-27086c53-f5fe-4451-9cef-79711f8eea3c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:49.708560 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-27086c53-f5fe-4451-9cef-79711f8eea3c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:49.716296 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-27086c53-f5fe-4451-9cef-79711f8eea3c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1260 microversion: 2.1 time: 0.153712 Dec 20 09:36:49.716864 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 564/1169] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:49 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:50.303948 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e7985971-53a4-43c0-9fec-42c01886794c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:50.304552 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e7985971-53a4-43c0-9fec-42c01886794c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:50.304754 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8ccb7308-8fa2-4129-b13a-35cfa5974c3f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:50.305402 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8ccb7308-8fa2-4129-b13a-35cfa5974c3f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:50.311318 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e7985971-53a4-43c0-9fec-42c01886794c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:50.311797 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e7985971-53a4-43c0-9fec-42c01886794c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:50.312072 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8ccb7308-8fa2-4129-b13a-35cfa5974c3f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:50.312526 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8ccb7308-8fa2-4129-b13a-35cfa5974c3f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:50.312629 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e7985971-53a4-43c0-9fec-42c01886794c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:50.312994 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e7985971-53a4-43c0-9fec-42c01886794c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:50.313306 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8ccb7308-8fa2-4129-b13a-35cfa5974c3f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:50.313744 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8ccb7308-8fa2-4129-b13a-35cfa5974c3f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:50.503098 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e7985971-53a4-43c0-9fec-42c01886794c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:50.510987 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e7985971-53a4-43c0-9fec-42c01886794c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1722 microversion: 2.1 time: 0.210697 Dec 20 09:36:50.511541 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 606/1170] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:50 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:50.523795 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8ccb7308-8fa2-4129-b13a-35cfa5974c3f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:50.531059 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8ccb7308-8fa2-4129-b13a-35cfa5974c3f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1754 microversion: 2.1 time: 0.229822 Dec 20 09:36:50.531566 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 565/1171] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:50 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1754 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:36:50.734815 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b076a302-0bd1-4f5e-a7ef-94fba2912921 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:50.735424 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b076a302-0bd1-4f5e-a7ef-94fba2912921 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:50.741374 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b076a302-0bd1-4f5e-a7ef-94fba2912921 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:50.741830 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b076a302-0bd1-4f5e-a7ef-94fba2912921 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:50.742984 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b076a302-0bd1-4f5e-a7ef-94fba2912921 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:50.743426 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b076a302-0bd1-4f5e-a7ef-94fba2912921 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:50.875688 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b076a302-0bd1-4f5e-a7ef-94fba2912921 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:50.882942 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b076a302-0bd1-4f5e-a7ef-94fba2912921 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1260 microversion: 2.1 time: 0.152440 Dec 20 09:36:50.883517 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 607/1172] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:50 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:51.527313 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9c081794-711b-4547-8fda-1e9b93fd3755 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:51.528796 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9c081794-711b-4547-8fda-1e9b93fd3755 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:51.537887 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9c081794-711b-4547-8fda-1e9b93fd3755 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:51.538340 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9c081794-711b-4547-8fda-1e9b93fd3755 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:51.539124 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9c081794-711b-4547-8fda-1e9b93fd3755 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:51.539563 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9c081794-711b-4547-8fda-1e9b93fd3755 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:51.548513 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-fac1dbac-c82f-4c97-9227-9020124e9504 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:51.549111 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-fac1dbac-c82f-4c97-9227-9020124e9504 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:51.555315 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fac1dbac-c82f-4c97-9227-9020124e9504 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:51.555793 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fac1dbac-c82f-4c97-9227-9020124e9504 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:51.556565 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fac1dbac-c82f-4c97-9227-9020124e9504 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:51.556998 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fac1dbac-c82f-4c97-9227-9020124e9504 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:51.736074 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-9c081794-711b-4547-8fda-1e9b93fd3755 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:51.744397 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9c081794-711b-4547-8fda-1e9b93fd3755 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1722 microversion: 2.1 time: 0.220752 Dec 20 09:36:51.744981 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 566/1173] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:51 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:51.752237 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-fac1dbac-c82f-4c97-9227-9020124e9504 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:51.760102 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-fac1dbac-c82f-4c97-9227-9020124e9504 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1754 microversion: 2.1 time: 0.215193 Dec 20 09:36:51.766384 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 608/1174] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:51 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1754 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:51.899106 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a54912ff-fc8d-459e-9e40-de7b1ac6e600 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:51.899752 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a54912ff-fc8d-459e-9e40-de7b1ac6e600 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:51.906049 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a54912ff-fc8d-459e-9e40-de7b1ac6e600 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:51.906491 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a54912ff-fc8d-459e-9e40-de7b1ac6e600 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:51.907259 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a54912ff-fc8d-459e-9e40-de7b1ac6e600 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:51.907717 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a54912ff-fc8d-459e-9e40-de7b1ac6e600 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:52.037177 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a54912ff-fc8d-459e-9e40-de7b1ac6e600 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:52.045208 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a54912ff-fc8d-459e-9e40-de7b1ac6e600 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1260 microversion: 2.1 time: 0.149701 Dec 20 09:36:52.045783 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 567/1175] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:51 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:52.263185 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 20 09:36:52.263377 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: Mon Dec 20 09:36:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 20 09:36:52.761214 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ac5da4cc-5c51-4653-b244-b473657458ee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:52.761821 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ac5da4cc-5c51-4653-b244-b473657458ee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:52.768710 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac5da4cc-5c51-4653-b244-b473657458ee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:52.769154 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac5da4cc-5c51-4653-b244-b473657458ee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:52.769934 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac5da4cc-5c51-4653-b244-b473657458ee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:52.770367 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac5da4cc-5c51-4653-b244-b473657458ee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:52.781533 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-be45d9ab-00dc-4318-a269-62ab491f2ef4 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:52.782149 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-be45d9ab-00dc-4318-a269-62ab491f2ef4 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:52.788451 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-be45d9ab-00dc-4318-a269-62ab491f2ef4 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:52.788912 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-be45d9ab-00dc-4318-a269-62ab491f2ef4 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:52.789688 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-be45d9ab-00dc-4318-a269-62ab491f2ef4 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:52.790123 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-be45d9ab-00dc-4318-a269-62ab491f2ef4 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:52.971515 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ac5da4cc-5c51-4653-b244-b473657458ee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:52.979355 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ac5da4cc-5c51-4653-b244-b473657458ee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1722 microversion: 2.1 time: 0.221803 Dec 20 09:36:52.979960 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 609/1176] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:52 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:52.989416 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-be45d9ab-00dc-4318-a269-62ab491f2ef4 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:52.998140 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-be45d9ab-00dc-4318-a269-62ab491f2ef4 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1754 microversion: 2.1 time: 0.220280 Dec 20 09:36:52.998700 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 568/1177] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:52 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1754 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:36:53.061951 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-cdd131c8-f538-4f85-85c5-8cf1390a8349 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:53.062661 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-cdd131c8-f538-4f85-85c5-8cf1390a8349 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:53.068497 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cdd131c8-f538-4f85-85c5-8cf1390a8349 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:53.068941 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cdd131c8-f538-4f85-85c5-8cf1390a8349 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:53.069712 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cdd131c8-f538-4f85-85c5-8cf1390a8349 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:53.070145 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cdd131c8-f538-4f85-85c5-8cf1390a8349 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:53.202889 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-cdd131c8-f538-4f85-85c5-8cf1390a8349 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:53.210397 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-cdd131c8-f538-4f85-85c5-8cf1390a8349 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1260 microversion: 2.1 time: 0.152741 Dec 20 09:36:53.210975 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 610/1178] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:53 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:53.996844 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-21fac1f0-3840-4ed0-8ac3-0faac42cccdc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:53.997439 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-21fac1f0-3840-4ed0-8ac3-0faac42cccdc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:54.003763 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-21fac1f0-3840-4ed0-8ac3-0faac42cccdc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:54.004210 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-21fac1f0-3840-4ed0-8ac3-0faac42cccdc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:54.004973 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-21fac1f0-3840-4ed0-8ac3-0faac42cccdc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:54.005402 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-21fac1f0-3840-4ed0-8ac3-0faac42cccdc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:54.015642 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4aba42ad-d668-46b0-a844-7de3ad0facf9 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:54.016311 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-4aba42ad-d668-46b0-a844-7de3ad0facf9 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:54.022494 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4aba42ad-d668-46b0-a844-7de3ad0facf9 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:54.022948 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4aba42ad-d668-46b0-a844-7de3ad0facf9 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:54.023749 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4aba42ad-d668-46b0-a844-7de3ad0facf9 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:54.024188 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4aba42ad-d668-46b0-a844-7de3ad0facf9 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:54.203966 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-21fac1f0-3840-4ed0-8ac3-0faac42cccdc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:54.211558 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-21fac1f0-3840-4ed0-8ac3-0faac42cccdc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1722 microversion: 2.1 time: 0.218612 Dec 20 09:36:54.212150 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 569/1179] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:53 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:54.219933 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-4aba42ad-d668-46b0-a844-7de3ad0facf9 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:54.225767 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b5eb9c80-0a1a-47e7-afb9-fcdf29fdbd8e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:54.226397 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b5eb9c80-0a1a-47e7-afb9-fcdf29fdbd8e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:54.228070 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-4aba42ad-d668-46b0-a844-7de3ad0facf9 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1754 microversion: 2.1 time: 0.216536 Dec 20 09:36:54.228793 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 611/1180] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:54 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1754 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:36:54.232029 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b5eb9c80-0a1a-47e7-afb9-fcdf29fdbd8e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:54.232472 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b5eb9c80-0a1a-47e7-afb9-fcdf29fdbd8e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:54.233233 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b5eb9c80-0a1a-47e7-afb9-fcdf29fdbd8e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:54.233690 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b5eb9c80-0a1a-47e7-afb9-fcdf29fdbd8e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:54.360985 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b5eb9c80-0a1a-47e7-afb9-fcdf29fdbd8e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:54.368455 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b5eb9c80-0a1a-47e7-afb9-fcdf29fdbd8e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1260 microversion: 2.1 time: 0.146210 Dec 20 09:36:54.369027 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 570/1181] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:54 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1260 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:36:55.227513 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-123e50d5-10f8-4c76-844e-61fbf7ad8302 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:55.228154 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-123e50d5-10f8-4c76-844e-61fbf7ad8302 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:55.234953 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-123e50d5-10f8-4c76-844e-61fbf7ad8302 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:55.235407 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-123e50d5-10f8-4c76-844e-61fbf7ad8302 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:55.236211 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-123e50d5-10f8-4c76-844e-61fbf7ad8302 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:55.236642 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-123e50d5-10f8-4c76-844e-61fbf7ad8302 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:55.245054 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-55838d22-7939-4b15-91b8-0ef72e07e6dd tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:55.245661 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-55838d22-7939-4b15-91b8-0ef72e07e6dd tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:55.252550 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-55838d22-7939-4b15-91b8-0ef72e07e6dd tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:55.253007 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-55838d22-7939-4b15-91b8-0ef72e07e6dd tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:55.253790 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-55838d22-7939-4b15-91b8-0ef72e07e6dd tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:55.254233 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-55838d22-7939-4b15-91b8-0ef72e07e6dd tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:55.432205 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-123e50d5-10f8-4c76-844e-61fbf7ad8302 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:55.440543 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-123e50d5-10f8-4c76-844e-61fbf7ad8302 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1722 microversion: 2.1 time: 0.216718 Dec 20 09:36:55.441121 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 612/1182] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:55 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:55.445381 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-627d6976-4767-4c68-b6c1-1dfc529fc2ed tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:55.445983 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-627d6976-4767-4c68-b6c1-1dfc529fc2ed tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:55.446343 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-55838d22-7939-4b15-91b8-0ef72e07e6dd tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:55.451773 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-627d6976-4767-4c68-b6c1-1dfc529fc2ed tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:55.452224 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-627d6976-4767-4c68-b6c1-1dfc529fc2ed tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:55.453000 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-627d6976-4767-4c68-b6c1-1dfc529fc2ed tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:55.453432 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-627d6976-4767-4c68-b6c1-1dfc529fc2ed tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:55.454598 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-55838d22-7939-4b15-91b8-0ef72e07e6dd tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1754 microversion: 2.1 time: 0.213385 Dec 20 09:36:55.455178 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 571/1183] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:55 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1754 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:36:55.583717 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-627d6976-4767-4c68-b6c1-1dfc529fc2ed tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:55.591706 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-627d6976-4767-4c68-b6c1-1dfc529fc2ed tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1260 microversion: 2.1 time: 0.149612 Dec 20 09:36:55.592279 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 613/1184] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:55 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:56.457073 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f2db4988-60e9-4c4a-8f79-332be94ff462 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:56.457683 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f2db4988-60e9-4c4a-8f79-332be94ff462 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:56.464011 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f2db4988-60e9-4c4a-8f79-332be94ff462 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:56.464462 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f2db4988-60e9-4c4a-8f79-332be94ff462 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:56.465233 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f2db4988-60e9-4c4a-8f79-332be94ff462 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:56.465672 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f2db4988-60e9-4c4a-8f79-332be94ff462 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:56.470737 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-cd70367d-1e96-4945-93e3-5539ba98dc28 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:56.471350 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-cd70367d-1e96-4945-93e3-5539ba98dc28 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:56.477539 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cd70367d-1e96-4945-93e3-5539ba98dc28 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:56.477992 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cd70367d-1e96-4945-93e3-5539ba98dc28 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:56.478772 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cd70367d-1e96-4945-93e3-5539ba98dc28 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:56.479209 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cd70367d-1e96-4945-93e3-5539ba98dc28 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:56.661970 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f2db4988-60e9-4c4a-8f79-332be94ff462 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:56.669739 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f2db4988-60e9-4c4a-8f79-332be94ff462 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1722 microversion: 2.1 time: 0.216292 Dec 20 09:36:56.670307 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 572/1185] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:56 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:56.674512 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e2fea7cf-b47b-4d11-a4d1-9a5fc1f60c11 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:56.675102 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e2fea7cf-b47b-4d11-a4d1-9a5fc1f60c11 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:56.675817 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-cd70367d-1e96-4945-93e3-5539ba98dc28 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:56.681381 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e2fea7cf-b47b-4d11-a4d1-9a5fc1f60c11 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:56.681829 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e2fea7cf-b47b-4d11-a4d1-9a5fc1f60c11 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:56.682605 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e2fea7cf-b47b-4d11-a4d1-9a5fc1f60c11 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:56.683040 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e2fea7cf-b47b-4d11-a4d1-9a5fc1f60c11 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:56.684285 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-cd70367d-1e96-4945-93e3-5539ba98dc28 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1754 microversion: 2.1 time: 0.216576 Dec 20 09:36:56.684956 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 614/1186] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:56 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1754 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:36:56.812499 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e2fea7cf-b47b-4d11-a4d1-9a5fc1f60c11 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:56.819555 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e2fea7cf-b47b-4d11-a4d1-9a5fc1f60c11 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1260 microversion: 2.1 time: 0.148320 Dec 20 09:36:56.820150 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 573/1187] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:56 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:57.686709 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-acb83d01-6870-4210-9628-7048e23d728a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:57.687253 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-acb83d01-6870-4210-9628-7048e23d728a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:57.693525 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-acb83d01-6870-4210-9628-7048e23d728a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:57.693979 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-acb83d01-6870-4210-9628-7048e23d728a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:57.694761 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-acb83d01-6870-4210-9628-7048e23d728a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:57.695200 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-acb83d01-6870-4210-9628-7048e23d728a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:57.705853 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-088fe0a3-9897-4388-9f37-3027753e90a0 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:57.706473 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-088fe0a3-9897-4388-9f37-3027753e90a0 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:57.712703 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-088fe0a3-9897-4388-9f37-3027753e90a0 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:57.713157 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-088fe0a3-9897-4388-9f37-3027753e90a0 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:57.713970 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-088fe0a3-9897-4388-9f37-3027753e90a0 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:57.714410 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-088fe0a3-9897-4388-9f37-3027753e90a0 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:57.890549 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-acb83d01-6870-4210-9628-7048e23d728a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:57.898245 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-acb83d01-6870-4210-9628-7048e23d728a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1722 microversion: 2.1 time: 0.215870 Dec 20 09:36:57.898815 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 615/1188] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:57 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:57.903505 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c0a9d7c2-290c-4ade-a277-b1079ca1cc07 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:57.904170 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c0a9d7c2-290c-4ade-a277-b1079ca1cc07 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:57.907151 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-088fe0a3-9897-4388-9f37-3027753e90a0 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:57.909760 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c0a9d7c2-290c-4ade-a277-b1079ca1cc07 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:57.910197 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c0a9d7c2-290c-4ade-a277-b1079ca1cc07 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:57.910983 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c0a9d7c2-290c-4ade-a277-b1079ca1cc07 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:57.911413 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c0a9d7c2-290c-4ade-a277-b1079ca1cc07 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:57.917362 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-088fe0a3-9897-4388-9f37-3027753e90a0 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1754 microversion: 2.1 time: 0.215044 Dec 20 09:36:57.918773 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 574/1189] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:57 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1754 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:36:58.043827 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-c0a9d7c2-290c-4ade-a277-b1079ca1cc07 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:58.051209 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c0a9d7c2-290c-4ade-a277-b1079ca1cc07 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1260 microversion: 2.1 time: 0.151457 Dec 20 09:36:58.051811 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 616/1190] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:57 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:58.915314 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ec23eb6e-ae16-4c0c-ba8c-89c4985a24ea tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:58.915925 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ec23eb6e-ae16-4c0c-ba8c-89c4985a24ea tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:58.922784 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ec23eb6e-ae16-4c0c-ba8c-89c4985a24ea tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:58.923227 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ec23eb6e-ae16-4c0c-ba8c-89c4985a24ea tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:58.924015 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ec23eb6e-ae16-4c0c-ba8c-89c4985a24ea tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:58.924445 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ec23eb6e-ae16-4c0c-ba8c-89c4985a24ea tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:58.933993 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0da9f2c8-ab8d-43bd-93ca-48d319ffd2f0 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:58.934610 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0da9f2c8-ab8d-43bd-93ca-48d319ffd2f0 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:58.940906 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0da9f2c8-ab8d-43bd-93ca-48d319ffd2f0 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:58.941356 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0da9f2c8-ab8d-43bd-93ca-48d319ffd2f0 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:58.942146 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0da9f2c8-ab8d-43bd-93ca-48d319ffd2f0 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:58.942581 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0da9f2c8-ab8d-43bd-93ca-48d319ffd2f0 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:59.135429 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ec23eb6e-ae16-4c0c-ba8c-89c4985a24ea tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:59.146507 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ec23eb6e-ae16-4c0c-ba8c-89c4985a24ea tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1722 microversion: 2.1 time: 0.234794 Dec 20 09:36:59.147091 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 575/1191] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:58 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:59.151553 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a41f6fa7-1f25-4127-8fb7-630de0449ccb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:59.152075 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a41f6fa7-1f25-4127-8fb7-630de0449ccb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:59.152275 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-0da9f2c8-ab8d-43bd-93ca-48d319ffd2f0 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:59.158488 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a41f6fa7-1f25-4127-8fb7-630de0449ccb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:59.158938 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a41f6fa7-1f25-4127-8fb7-630de0449ccb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:59.159753 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a41f6fa7-1f25-4127-8fb7-630de0449ccb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:59.160192 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a41f6fa7-1f25-4127-8fb7-630de0449ccb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:59.160581 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0da9f2c8-ab8d-43bd-93ca-48d319ffd2f0 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1754 microversion: 2.1 time: 0.230282 Dec 20 09:36:59.161152 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 617/1192] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:58 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1754 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:59.165458 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f009fb69-766a-4627-999c-3de67ac3b15e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:59.165998 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f009fb69-766a-4627-999c-3de67ac3b15e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:59.171473 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f009fb69-766a-4627-999c-3de67ac3b15e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:59.171937 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f009fb69-766a-4627-999c-3de67ac3b15e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:59.172759 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f009fb69-766a-4627-999c-3de67ac3b15e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:59.173206 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f009fb69-766a-4627-999c-3de67ac3b15e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:59.188633 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a41f6fa7-1f25-4127-8fb7-630de0449ccb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/os-volume_attachments/c92b90fa-4e49-4235-bb66-5f5f7e4758c8" status: 200 len: 194 microversion: 2.20 time: 0.040515 Dec 20 09:36:59.189400 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 576/1193] 10.222.0.62 () {60 vars in 1453 bytes} [Mon Dec 20 09:36:59 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/os-volume_attachments/c92b90fa-4e49-4235-bb66-5f5f7e4758c8 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:36:59.248188 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-cc236d5d-4ce4-405a-ba8d-777ffbddef5c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:59.248677 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-cc236d5d-4ce4-405a-ba8d-777ffbddef5c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:59.254394 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cc236d5d-4ce4-405a-ba8d-777ffbddef5c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:59.254839 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cc236d5d-4ce4-405a-ba8d-777ffbddef5c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:59.255608 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cc236d5d-4ce4-405a-ba8d-777ffbddef5c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:59.256062 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cc236d5d-4ce4-405a-ba8d-777ffbddef5c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:59.309435 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f009fb69-766a-4627-999c-3de67ac3b15e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:36:59.316927 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f009fb69-766a-4627-999c-3de67ac3b15e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1260 microversion: 2.1 time: 0.154820 Dec 20 09:36:59.317502 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 618/1194] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:36:59 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:36:59.333160 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.objects.instance [None req-cc236d5d-4ce4-405a-ba8d-777ffbddef5c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lazy-loading 'services' on Instance uuid c9ba0eda-fab4-44dc-b41f-0c51574dca1f {{(pid=116675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:36:59.543469 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-cc236d5d-4ce4-405a-ba8d-777ffbddef5c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/os-volume_attachments/c92b90fa-4e49-4235-bb66-5f5f7e4758c8" status: 202 len: 0 microversion: 2.20 time: 0.298853 Dec 20 09:36:59.544482 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 577/1195] 10.222.0.62 () {60 vars in 1456 bytes} [Mon Dec 20 09:36:59 2021] DELETE /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/os-volume_attachments/c92b90fa-4e49-4235-bb66-5f5f7e4758c8 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 20 09:36:59.552510 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0c962411-aed6-4401-b905-7268a853cc68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:36:59.553528 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0c962411-aed6-4401-b905-7268a853cc68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:36:59.560042 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0c962411-aed6-4401-b905-7268a853cc68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:59.560498 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0c962411-aed6-4401-b905-7268a853cc68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:59.561278 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0c962411-aed6-4401-b905-7268a853cc68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:36:59.561712 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0c962411-aed6-4401-b905-7268a853cc68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:36:59.590972 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0c962411-aed6-4401-b905-7268a853cc68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042172 Dec 20 09:36:59.591529 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 619/1196] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Dec 20 09:36:59 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:37:00.164304 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d7ed17c7-8f4c-49fb-a7ea-05f1980e547a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:00.165138 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d7ed17c7-8f4c-49fb-a7ea-05f1980e547a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:00.172962 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d7ed17c7-8f4c-49fb-a7ea-05f1980e547a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:00.172962 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d7ed17c7-8f4c-49fb-a7ea-05f1980e547a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:00.173854 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d7ed17c7-8f4c-49fb-a7ea-05f1980e547a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:00.174174 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d7ed17c7-8f4c-49fb-a7ea-05f1980e547a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:00.178209 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-bda70f12-ce2f-4c83-8b91-41d4dd7d6758 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:00.178909 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-bda70f12-ce2f-4c83-8b91-41d4dd7d6758 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:00.188819 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bda70f12-ce2f-4c83-8b91-41d4dd7d6758 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:00.189339 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bda70f12-ce2f-4c83-8b91-41d4dd7d6758 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:00.190705 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bda70f12-ce2f-4c83-8b91-41d4dd7d6758 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:00.190705 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bda70f12-ce2f-4c83-8b91-41d4dd7d6758 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:00.376169 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d7ed17c7-8f4c-49fb-a7ea-05f1980e547a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:00.384255 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d7ed17c7-8f4c-49fb-a7ea-05f1980e547a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1722 microversion: 2.1 time: 0.224027 Dec 20 09:37:00.385058 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 578/1197] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:37:00 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:37:00.393291 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-25dd5897-1f45-428d-a4de-4711d8f4c37b tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:00.394142 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-25dd5897-1f45-428d-a4de-4711d8f4c37b tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:00.401291 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-25dd5897-1f45-428d-a4de-4711d8f4c37b tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:00.401764 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-25dd5897-1f45-428d-a4de-4711d8f4c37b tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:00.403060 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-bda70f12-ce2f-4c83-8b91-41d4dd7d6758 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:00.403218 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-25dd5897-1f45-428d-a4de-4711d8f4c37b tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:00.403577 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-25dd5897-1f45-428d-a4de-4711d8f4c37b tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:00.413007 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-bda70f12-ce2f-4c83-8b91-41d4dd7d6758 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1754 microversion: 2.1 time: 0.238388 Dec 20 09:37:00.413582 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 620/1198] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:37:00 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1754 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:37:00.538601 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-25dd5897-1f45-428d-a4de-4711d8f4c37b tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:00.546297 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-25dd5897-1f45-428d-a4de-4711d8f4c37b tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1260 microversion: 2.1 time: 0.157655 Dec 20 09:37:00.546851 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 579/1199] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:37:00 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:37:00.604671 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-68a5f342-2acc-4539-8302-4d87ced82b86 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:00.606199 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-68a5f342-2acc-4539-8302-4d87ced82b86 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:00.612401 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-68a5f342-2acc-4539-8302-4d87ced82b86 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:00.612832 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-68a5f342-2acc-4539-8302-4d87ced82b86 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:00.613605 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-68a5f342-2acc-4539-8302-4d87ced82b86 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:00.614038 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-68a5f342-2acc-4539-8302-4d87ced82b86 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:00.642966 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-68a5f342-2acc-4539-8302-4d87ced82b86 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041976 Dec 20 09:37:00.643536 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 621/1200] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Dec 20 09:37:00 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:37:00.698325 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8def0597-5346-4f95-be06-14ff0aa4b253 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:00.698932 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8def0597-5346-4f95-be06-14ff0aa4b253 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:00.704800 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8def0597-5346-4f95-be06-14ff0aa4b253 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:00.705322 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8def0597-5346-4f95-be06-14ff0aa4b253 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:00.706207 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8def0597-5346-4f95-be06-14ff0aa4b253 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:00.706707 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8def0597-5346-4f95-be06-14ff0aa4b253 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:00.731549 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8def0597-5346-4f95-be06-14ff0aa4b253 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Going to try to terminate instance {{(pid=116675) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 09:37:00.989723 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8def0597-5346-4f95-be06-14ff0aa4b253 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 204 len: 0 microversion: 2.20 time: 0.294813 Dec 20 09:37:00.990320 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 580/1201] 10.222.0.62 () {60 vars in 1279 bytes} [Mon Dec 20 09:37:00 2021] DELETE /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 20 09:37:00.998464 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a24d91f3-995a-46e8-9dfd-d94b6bf51c42 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:00.999069 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a24d91f3-995a-46e8-9dfd-d94b6bf51c42 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:01.005075 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a24d91f3-995a-46e8-9dfd-d94b6bf51c42 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:01.005524 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a24d91f3-995a-46e8-9dfd-d94b6bf51c42 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:01.006301 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a24d91f3-995a-46e8-9dfd-d94b6bf51c42 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:01.006742 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a24d91f3-995a-46e8-9dfd-d94b6bf51c42 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:01.135549 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a24d91f3-995a-46e8-9dfd-d94b6bf51c42 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:01.143254 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a24d91f3-995a-46e8-9dfd-d94b6bf51c42 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:01.144764 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a24d91f3-995a-46e8-9dfd-d94b6bf51c42 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:01.145918 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a24d91f3-995a-46e8-9dfd-d94b6bf51c42 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1723 microversion: 2.20 time: 0.151142 Dec 20 09:37:01.146485 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 622/1202] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:37:00 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:37:01.403473 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1fcc4be1-69e3-4ceb-9c1d-d1929b99f969 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:01.404215 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1fcc4be1-69e3-4ceb-9c1d-d1929b99f969 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:01.411583 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1fcc4be1-69e3-4ceb-9c1d-d1929b99f969 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:01.412069 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1fcc4be1-69e3-4ceb-9c1d-d1929b99f969 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:01.412943 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1fcc4be1-69e3-4ceb-9c1d-d1929b99f969 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:01.413381 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1fcc4be1-69e3-4ceb-9c1d-d1929b99f969 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:01.429413 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f399206f-5c12-4909-89e7-45a157a8b421 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:01.430054 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f399206f-5c12-4909-89e7-45a157a8b421 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:01.436526 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f399206f-5c12-4909-89e7-45a157a8b421 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:01.436979 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f399206f-5c12-4909-89e7-45a157a8b421 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:01.437785 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f399206f-5c12-4909-89e7-45a157a8b421 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:01.438214 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f399206f-5c12-4909-89e7-45a157a8b421 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:01.609661 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1fcc4be1-69e3-4ceb-9c1d-d1929b99f969 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:01.617693 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1fcc4be1-69e3-4ceb-9c1d-d1929b99f969 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1699 microversion: 2.1 time: 0.218623 Dec 20 09:37:01.618270 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 581/1203] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:37:01 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1699 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:37:01.622989 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-acb6a583-7946-483c-987d-c4e7ec920295 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:01.623591 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-acb6a583-7946-483c-987d-c4e7ec920295 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:01.626115 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f399206f-5c12-4909-89e7-45a157a8b421 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:01.629391 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-acb6a583-7946-483c-987d-c4e7ec920295 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:01.629844 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-acb6a583-7946-483c-987d-c4e7ec920295 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:01.630634 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-acb6a583-7946-483c-987d-c4e7ec920295 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:01.631067 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-acb6a583-7946-483c-987d-c4e7ec920295 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:01.635339 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f399206f-5c12-4909-89e7-45a157a8b421 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1754 microversion: 2.1 time: 0.209569 Dec 20 09:37:01.635939 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 623/1204] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:37:01 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1754 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:37:01.642698 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e1e6c2c7-3a41-4276-83ab-8b595847dc8e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:01.657835 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e1e6c2c7-3a41-4276-83ab-8b595847dc8e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:01.658194 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e1e6c2c7-3a41-4276-83ab-8b595847dc8e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:01.719528 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e1e6c2c7-3a41-4276-83ab-8b595847dc8e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Going to try to start instance {{(pid=116674) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 20 09:37:01.769237 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-acb6a583-7946-483c-987d-c4e7ec920295 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:01.776627 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-acb6a583-7946-483c-987d-c4e7ec920295 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1260 microversion: 2.1 time: 0.157429 Dec 20 09:37:01.777198 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 582/1205] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:37:01 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:37:01.890456 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e1e6c2c7-3a41-4276-83ab-8b595847dc8e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 202 len: 0 microversion: 2.1 time: 0.253301 Dec 20 09:37:01.891734 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 624/1206] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:37:01 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:37:01.899532 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c379e209-440e-4a6e-9ed7-0ea4901f050c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:01.900232 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c379e209-440e-4a6e-9ed7-0ea4901f050c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:01.906123 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c379e209-440e-4a6e-9ed7-0ea4901f050c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:01.906574 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c379e209-440e-4a6e-9ed7-0ea4901f050c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:01.907434 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c379e209-440e-4a6e-9ed7-0ea4901f050c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:01.907949 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c379e209-440e-4a6e-9ed7-0ea4901f050c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:02.042170 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-c379e209-440e-4a6e-9ed7-0ea4901f050c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:02.052182 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c379e209-440e-4a6e-9ed7-0ea4901f050c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1708 microversion: 2.1 time: 0.156286 Dec 20 09:37:02.052758 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 583/1207] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:37:01 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1708 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:37:02.165248 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-37d663ee-3a7e-45e9-9a7b-b7e61ba9a859 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:02.166296 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-37d663ee-3a7e-45e9-9a7b-b7e61ba9a859 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:02.173148 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37d663ee-3a7e-45e9-9a7b-b7e61ba9a859 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:02.173604 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37d663ee-3a7e-45e9-9a7b-b7e61ba9a859 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:02.174390 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37d663ee-3a7e-45e9-9a7b-b7e61ba9a859 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:02.174835 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-37d663ee-3a7e-45e9-9a7b-b7e61ba9a859 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:02.271000 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-36de9f6c-752b-4e38-9958-ddf64c4cdc76 req-ff18443b-0969-4d60-8ae6-dc2627d99f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2454a5d-038c-422c-8b61-b88674e18a3c", "name": "network-vif-plugged", "status": "completed", "tag": "4bfd2d96-5b20-4456-afea-5b3bbf0b1cfe"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:02.272954 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:37:02.272954 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:37:02.281069 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-36de9f6c-752b-4e38-9958-ddf64c4cdc76 req-ff18443b-0969-4d60-8ae6-dc2627d99f4d service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:02.281069 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-36de9f6c-752b-4e38-9958-ddf64c4cdc76 req-ff18443b-0969-4d60-8ae6-dc2627d99f4d service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:02.292571 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-36de9f6c-752b-4e38-9958-ddf64c4cdc76 req-ff18443b-0969-4d60-8ae6-dc2627d99f4d service nova] Creating event network-vif-plugged:4bfd2d96-5b20-4456-afea-5b3bbf0b1cfe for instance b2454a5d-038c-422c-8b61-b88674e18a3c on hv-cinder-81908 Dec 20 09:37:02.298570 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-36de9f6c-752b-4e38-9958-ddf64c4cdc76 req-ff18443b-0969-4d60-8ae6-dc2627d99f4d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031062 Dec 20 09:37:02.299543 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 584/1208] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:37:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:37:02.319444 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-37d663ee-3a7e-45e9-9a7b-b7e61ba9a859 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:02.328805 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-37d663ee-3a7e-45e9-9a7b-b7e61ba9a859 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:02.330372 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-37d663ee-3a7e-45e9-9a7b-b7e61ba9a859 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:02.331590 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-37d663ee-3a7e-45e9-9a7b-b7e61ba9a859 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1723 microversion: 2.20 time: 0.170688 Dec 20 09:37:02.332535 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 625/1209] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:37:02 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:37:02.659610 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4d92c775-9959-4a3e-b97c-f6d318e68d2b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:02.660344 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4d92c775-9959-4a3e-b97c-f6d318e68d2b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:02.666617 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4d92c775-9959-4a3e-b97c-f6d318e68d2b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:02.667076 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4d92c775-9959-4a3e-b97c-f6d318e68d2b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:02.668651 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4d92c775-9959-4a3e-b97c-f6d318e68d2b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:02.668937 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4d92c775-9959-4a3e-b97c-f6d318e68d2b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:02.792900 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8d1c3122-20af-4ed6-b9b8-c011e410e0c1 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:02.793503 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-8d1c3122-20af-4ed6-b9b8-c011e410e0c1 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:02.799803 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8d1c3122-20af-4ed6-b9b8-c011e410e0c1 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:02.800251 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8d1c3122-20af-4ed6-b9b8-c011e410e0c1 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:02.801031 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8d1c3122-20af-4ed6-b9b8-c011e410e0c1 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:02.801467 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8d1c3122-20af-4ed6-b9b8-c011e410e0c1 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:02.815449 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-4d92c775-9959-4a3e-b97c-f6d318e68d2b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:02.823872 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4d92c775-9959-4a3e-b97c-f6d318e68d2b tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1754 microversion: 2.1 time: 0.168704 Dec 20 09:37:02.825278 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 585/1210] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:37:02 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:37:02.934334 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-8d1c3122-20af-4ed6-b9b8-c011e410e0c1 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:02.941655 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8d1c3122-20af-4ed6-b9b8-c011e410e0c1 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1260 microversion: 2.1 time: 0.152342 Dec 20 09:37:02.942218 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 626/1211] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:37:02 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:37:03.069846 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-7c02a9aa-a935-4e77-bb98-13c2f31253b2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:03.070375 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-7c02a9aa-a935-4e77-bb98-13c2f31253b2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:03.076165 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7c02a9aa-a935-4e77-bb98-13c2f31253b2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:03.076620 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7c02a9aa-a935-4e77-bb98-13c2f31253b2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:03.077398 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7c02a9aa-a935-4e77-bb98-13c2f31253b2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:03.077835 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7c02a9aa-a935-4e77-bb98-13c2f31253b2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:03.210168 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-7c02a9aa-a935-4e77-bb98-13c2f31253b2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:03.218433 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-7c02a9aa-a935-4e77-bb98-13c2f31253b2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1708 microversion: 2.1 time: 0.152340 Dec 20 09:37:03.219030 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 586/1212] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:37:03 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1708 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:37:03.350325 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c20b7da0-bf7c-4f7d-8df1-7acaec455646 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:03.350927 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c20b7da0-bf7c-4f7d-8df1-7acaec455646 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:03.357322 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c20b7da0-bf7c-4f7d-8df1-7acaec455646 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:03.357762 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c20b7da0-bf7c-4f7d-8df1-7acaec455646 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:03.358524 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c20b7da0-bf7c-4f7d-8df1-7acaec455646 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:03.358953 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c20b7da0-bf7c-4f7d-8df1-7acaec455646 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:03.491725 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-c20b7da0-bf7c-4f7d-8df1-7acaec455646 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:03.504508 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-c20b7da0-bf7c-4f7d-8df1-7acaec455646 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:03.506699 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-c20b7da0-bf7c-4f7d-8df1-7acaec455646 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:03.508630 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c20b7da0-bf7c-4f7d-8df1-7acaec455646 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1723 microversion: 2.20 time: 0.162175 Dec 20 09:37:03.509196 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 627/1213] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:37:03 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:37:03.841760 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-7a67cf61-ddc0-43a1-940c-5c90e3878e4f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:03.842522 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-7a67cf61-ddc0-43a1-940c-5c90e3878e4f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:03.854718 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7a67cf61-ddc0-43a1-940c-5c90e3878e4f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:03.854718 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7a67cf61-ddc0-43a1-940c-5c90e3878e4f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:03.855464 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7a67cf61-ddc0-43a1-940c-5c90e3878e4f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:03.856381 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7a67cf61-ddc0-43a1-940c-5c90e3878e4f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:03.957926 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8951899d-74ca-443e-bd4c-6ece4125b8bf tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:03.958711 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-8951899d-74ca-443e-bd4c-6ece4125b8bf tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:03.965686 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8951899d-74ca-443e-bd4c-6ece4125b8bf tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:03.966259 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8951899d-74ca-443e-bd4c-6ece4125b8bf tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:03.967176 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8951899d-74ca-443e-bd4c-6ece4125b8bf tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:03.967690 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8951899d-74ca-443e-bd4c-6ece4125b8bf tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:04.026128 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-7a67cf61-ddc0-43a1-940c-5c90e3878e4f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:04.035809 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-7a67cf61-ddc0-43a1-940c-5c90e3878e4f tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1754 microversion: 2.1 time: 0.197958 Dec 20 09:37:04.036687 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 587/1214] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:37:03 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1754 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:37:04.120474 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-8951899d-74ca-443e-bd4c-6ece4125b8bf tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:04.129406 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8951899d-74ca-443e-bd4c-6ece4125b8bf tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1260 microversion: 2.1 time: 0.175018 Dec 20 09:37:04.130599 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 628/1215] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:37:03 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:37:04.235434 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-40546f5f-1c2a-459d-8b70-cdea8d7fc111 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:04.236085 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-40546f5f-1c2a-459d-8b70-cdea8d7fc111 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:04.250144 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-40546f5f-1c2a-459d-8b70-cdea8d7fc111 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:04.251047 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-40546f5f-1c2a-459d-8b70-cdea8d7fc111 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:04.251951 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-40546f5f-1c2a-459d-8b70-cdea8d7fc111 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:04.252397 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-40546f5f-1c2a-459d-8b70-cdea8d7fc111 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:04.360207 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-1529dfd7-a7e4-4733-8404-3057b9376b72 req-766765b0-0d24-4677-ac9a-7f260953911f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9ba0eda-fab4-44dc-b41f-0c51574dca1f", "name": "network-vif-deleted", "tag": "b868aa5a-bfbe-4a31-ac51-6ef583b78b0e"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:04.361746 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:37:04.361746 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:37:04.368936 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-1529dfd7-a7e4-4733-8404-3057b9376b72 req-766765b0-0d24-4677-ac9a-7f260953911f service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:04.369382 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-1529dfd7-a7e4-4733-8404-3057b9376b72 req-766765b0-0d24-4677-ac9a-7f260953911f service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:04.381112 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-1529dfd7-a7e4-4733-8404-3057b9376b72 req-766765b0-0d24-4677-ac9a-7f260953911f service nova] Creating event network-vif-deleted:b868aa5a-bfbe-4a31-ac51-6ef583b78b0e for instance c9ba0eda-fab4-44dc-b41f-0c51574dca1f on hv-cinder-81908 Dec 20 09:37:04.387417 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-1529dfd7-a7e4-4733-8404-3057b9376b72 req-766765b0-0d24-4677-ac9a-7f260953911f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030704 Dec 20 09:37:04.388073 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 629/1216] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:37:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:37:04.422000 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-40546f5f-1c2a-459d-8b70-cdea8d7fc111 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:04.430720 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-40546f5f-1c2a-459d-8b70-cdea8d7fc111 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1712 microversion: 2.1 time: 0.199341 Dec 20 09:37:04.431561 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 588/1217] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:37:04 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1712 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:37:04.529219 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-baf823e0-18c4-4319-9786-98cd70c976ae tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:04.529918 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-baf823e0-18c4-4319-9786-98cd70c976ae tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:04.537482 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-baf823e0-18c4-4319-9786-98cd70c976ae tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:04.539002 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-baf823e0-18c4-4319-9786-98cd70c976ae tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:04.539002 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-baf823e0-18c4-4319-9786-98cd70c976ae tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:04.539228 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-baf823e0-18c4-4319-9786-98cd70c976ae tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:04.619803 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-baf823e0-18c4-4319-9786-98cd70c976ae tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:04.628202 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-baf823e0-18c4-4319-9786-98cd70c976ae tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:04.629742 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-baf823e0-18c4-4319-9786-98cd70c976ae tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:04.630900 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-baf823e0-18c4-4319-9786-98cd70c976ae tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 200 len: 1366 microversion: 2.20 time: 0.106642 Dec 20 09:37:04.631463 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 630/1218] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:37:04 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 1366 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:37:05.053167 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4e8379d8-2d78-4ec4-962f-4cb705c94e0d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:05.053781 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4e8379d8-2d78-4ec4-962f-4cb705c94e0d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:05.060941 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4e8379d8-2d78-4ec4-962f-4cb705c94e0d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:05.061398 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4e8379d8-2d78-4ec4-962f-4cb705c94e0d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:05.062820 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4e8379d8-2d78-4ec4-962f-4cb705c94e0d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:05.063274 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4e8379d8-2d78-4ec4-962f-4cb705c94e0d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:05.151322 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-202baac6-245f-4707-b9ae-b92237bef2e7 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:05.154072 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-202baac6-245f-4707-b9ae-b92237bef2e7 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:05.164991 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-202baac6-245f-4707-b9ae-b92237bef2e7 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:05.165724 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-202baac6-245f-4707-b9ae-b92237bef2e7 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:05.166695 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-202baac6-245f-4707-b9ae-b92237bef2e7 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:05.168368 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-202baac6-245f-4707-b9ae-b92237bef2e7 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:05.261170 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-4e8379d8-2d78-4ec4-962f-4cb705c94e0d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:05.270985 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4e8379d8-2d78-4ec4-962f-4cb705c94e0d tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1757 microversion: 2.1 time: 0.221139 Dec 20 09:37:05.284251 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 589/1219] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:37:05 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1757 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:37:05.345287 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-202baac6-245f-4707-b9ae-b92237bef2e7 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:05.352936 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-202baac6-245f-4707-b9ae-b92237bef2e7 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1444 microversion: 2.1 time: 0.205658 Dec 20 09:37:05.353743 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 631/1220] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:37:05 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1444 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:37:05.375012 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c97d3322-d512-40c4-a367-424c6278dc67 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:05.375819 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c97d3322-d512-40c4-a367-424c6278dc67 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:05.384431 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c97d3322-d512-40c4-a367-424c6278dc67 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:05.384431 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c97d3322-d512-40c4-a367-424c6278dc67 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:05.384752 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c97d3322-d512-40c4-a367-424c6278dc67 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:05.385138 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c97d3322-d512-40c4-a367-424c6278dc67 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:05.528304 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-c97d3322-d512-40c4-a367-424c6278dc67 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:05.535921 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c97d3322-d512-40c4-a367-424c6278dc67 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1444 microversion: 2.1 time: 0.165024 Dec 20 09:37:05.536542 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 590/1221] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:37:05 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1444 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:37:05.654315 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4c444060-d97c-4987-a498-401fcaed6439 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:05.654917 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-4c444060-d97c-4987-a498-401fcaed6439 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:05.661008 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4c444060-d97c-4987-a498-401fcaed6439 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:05.661451 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4c444060-d97c-4987-a498-401fcaed6439 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:05.662233 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4c444060-d97c-4987-a498-401fcaed6439 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:05.662665 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4c444060-d97c-4987-a498-401fcaed6439 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:05.676785 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.wsgi [None req-4c444060-d97c-4987-a498-401fcaed6439 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] HTTP exception thrown: Instance c9ba0eda-fab4-44dc-b41f-0c51574dca1f could not be found. Dec 20 09:37:05.677370 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4c444060-d97c-4987-a498-401fcaed6439 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Returning 404 to user: Instance c9ba0eda-fab4-44dc-b41f-0c51574dca1f could not be found. {{(pid=116674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:37:05.678202 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-4c444060-d97c-4987-a498-401fcaed6439 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 404 len: 111 microversion: 2.20 time: 0.033208 Dec 20 09:37:05.678788 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 632/1222] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:37:05 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 20 09:37:05.687072 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a1bf8c34-aa87-4d70-bb7c-3e5ce05e821d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '.version_select at 0x7f914f3fd430>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:05.780384 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a1bf8c34-aa87-4d70-bb7c-3e5ce05e821d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1885543107" status: 204 len: 0 microversion: 2.20 time: 0.096956 Dec 20 09:37:05.780972 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 591/1223] 10.222.0.62 () {60 vars in 1261 bytes} [Mon Dec 20 09:37:05 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1885543107 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 20 09:37:06.856228 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3ed4e953-6337-4840-bd01-9b3cb213d1e1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'create', calling method: .version_select at 0x7f914e48c790>, body: {"keypair": {"name": "tempest-keypair-1328180579"}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:06.871429 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-3ed4e953-6337-4840-bd01-9b3cb213d1e1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Getting quotas for project b2ad93eaa3c541839f4737919bf7dc8c. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:37:06.875484 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-3ed4e953-6337-4840-bd01-9b3cb213d1e1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Getting quotas for user b25e3e674c0e4530b1760b2a9d769851 and project b2ad93eaa3c541839f4737919bf7dc8c. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:37:07.406443 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-3ed4e953-6337-4840-bd01-9b3cb213d1e1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Getting quotas for project b2ad93eaa3c541839f4737919bf7dc8c. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:37:07.410310 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-3ed4e953-6337-4840-bd01-9b3cb213d1e1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Getting quotas for user b25e3e674c0e4530b1760b2a9d769851 and project b2ad93eaa3c541839f4737919bf7dc8c. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:37:07.423042 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3ed4e953-6337-4840-bd01-9b3cb213d1e1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.570730 Dec 20 09:37:07.423645 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 633/1224] 10.222.0.62 () {62 vars in 1198 bytes} [Mon Dec 20 09:37:06 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 572 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 20 09:37:07.799451 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-8462e689-c296-433d-b2b9-319b8d7e9de0 req-68de4a64-4fe7-4ef0-9a9c-761f7aef227c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2454a5d-038c-422c-8b61-b88674e18a3c", "tag": "4bfd2d96-5b20-4456-afea-5b3bbf0b1cfe"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:07.800953 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:37:07.800953 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:37:07.809844 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-8462e689-c296-433d-b2b9-319b8d7e9de0 req-68de4a64-4fe7-4ef0-9a9c-761f7aef227c service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:07.810333 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-8462e689-c296-433d-b2b9-319b8d7e9de0 req-68de4a64-4fe7-4ef0-9a9c-761f7aef227c service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:07.820497 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-8462e689-c296-433d-b2b9-319b8d7e9de0 req-68de4a64-4fe7-4ef0-9a9c-761f7aef227c service nova] Creating event network-changed:4bfd2d96-5b20-4456-afea-5b3bbf0b1cfe for instance b2454a5d-038c-422c-8b61-b88674e18a3c on hv-cinder-81908 Dec 20 09:37:07.826261 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-8462e689-c296-433d-b2b9-319b8d7e9de0 req-68de4a64-4fe7-4ef0-9a9c-761f7aef227c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030439 Dec 20 09:37:07.827898 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 592/1225] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:37:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:37:09.593819 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d4fa3568-4c4f-492c-b84a-85fb281b83c7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-834951014", "imageRef": "6f828f0b-c445-46a5-9960-492746785ef3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c447227-4876-4dd2-a864-17e79eef283a"}], "security_groups": [{"name": "tempest-securitygroup--2012927754"}], "key_name": "tempest-keypair-1328180579", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:09.691191 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.network.neutron [None req-d4fa3568-4c4f-492c-b84a-85fb281b83c7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] validate_networks() for [('1c447227-4876-4dd2-a864-17e79eef283a', None, None, None, None, None)] {{(pid=116674) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 09:37:10.255955 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-d4fa3568-4c4f-492c-b84a-85fb281b83c7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Flavor limits 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 09:37:10.256389 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-d4fa3568-4c4f-492c-b84a-85fb281b83c7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Image limits 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 09:37:10.256863 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-d4fa3568-4c4f-492c-b84a-85fb281b83c7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Flavor pref 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 09:37:10.257274 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-d4fa3568-4c4f-492c-b84a-85fb281b83c7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Image pref 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 09:37:10.257689 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-d4fa3568-4c4f-492c-b84a-85fb281b83c7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 09:37:10.266357 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d4fa3568-4c4f-492c-b84a-85fb281b83c7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:10.266807 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d4fa3568-4c4f-492c-b84a-85fb281b83c7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:10.267622 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d4fa3568-4c4f-492c-b84a-85fb281b83c7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:10.268092 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d4fa3568-4c4f-492c-b84a-85fb281b83c7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:10.284633 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-d4fa3568-4c4f-492c-b84a-85fb281b83c7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Getting quotas for project b2ad93eaa3c541839f4737919bf7dc8c. Resources: {'ram', 'cores', 'instances'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:37:10.288606 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-d4fa3568-4c4f-492c-b84a-85fb281b83c7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Getting quotas for user b25e3e674c0e4530b1760b2a9d769851 and project b2ad93eaa3c541839f4737919bf7dc8c. Resources: {'ram', 'cores', 'instances'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:37:10.300279 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d4fa3568-4c4f-492c-b84a-85fb281b83c7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Going to run 1 instances... {{(pid=116674) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 09:37:10.302585 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d4fa3568-4c4f-492c-b84a-85fb281b83c7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f828f0b-c445-46a5-9960-492746785ef3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 09:37:10.414495 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d4fa3568-4c4f-492c-b84a-85fb281b83c7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.825899 Dec 20 09:37:10.415149 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 634/1226] 10.222.0.62 () {62 vars in 1187 bytes} [Mon Dec 20 09:37:09 2021] POST /compute/v2.1/servers => generated 402 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Dec 20 09:37:10.426602 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-bc37d92e-3251-4682-8ab4-573015b49768 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:10.427304 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-bc37d92e-3251-4682-8ab4-573015b49768 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:10.478974 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-bc37d92e-3251-4682-8ab4-573015b49768 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:10.486493 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-bc37d92e-3251-4682-8ab4-573015b49768 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:10.488008 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-bc37d92e-3251-4682-8ab4-573015b49768 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:10.489112 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-bc37d92e-3251-4682-8ab4-573015b49768 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1281 microversion: 2.20 time: 0.067148 Dec 20 09:37:10.489798 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 593/1227] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:37:10 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1281 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:37:11.508707 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-08dc5151-44a7-47cd-b84e-fc1c600146b7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:11.509777 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-08dc5151-44a7-47cd-b84e-fc1c600146b7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:11.517017 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-08dc5151-44a7-47cd-b84e-fc1c600146b7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:11.517459 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-08dc5151-44a7-47cd-b84e-fc1c600146b7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:11.518271 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-08dc5151-44a7-47cd-b84e-fc1c600146b7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:11.518741 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-08dc5151-44a7-47cd-b84e-fc1c600146b7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:11.577583 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-08dc5151-44a7-47cd-b84e-fc1c600146b7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:11.586598 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-08dc5151-44a7-47cd-b84e-fc1c600146b7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:11.588151 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-08dc5151-44a7-47cd-b84e-fc1c600146b7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:11.589276 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-08dc5151-44a7-47cd-b84e-fc1c600146b7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1277 microversion: 2.20 time: 0.085525 Dec 20 09:37:11.589823 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 635/1228] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:37:11 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1277 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:37:12.606626 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ca91d186-d7e7-4439-bf7e-4961cf91c5c4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:12.607441 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ca91d186-d7e7-4439-bf7e-4961cf91c5c4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:12.614802 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ca91d186-d7e7-4439-bf7e-4961cf91c5c4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:12.615260 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ca91d186-d7e7-4439-bf7e-4961cf91c5c4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:12.616094 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ca91d186-d7e7-4439-bf7e-4961cf91c5c4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:12.616535 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ca91d186-d7e7-4439-bf7e-4961cf91c5c4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:12.675481 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ca91d186-d7e7-4439-bf7e-4961cf91c5c4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:12.683431 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ca91d186-d7e7-4439-bf7e-4961cf91c5c4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:12.686599 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ca91d186-d7e7-4439-bf7e-4961cf91c5c4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:12.686599 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ca91d186-d7e7-4439-bf7e-4961cf91c5c4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1339 microversion: 2.20 time: 0.083165 Dec 20 09:37:12.687312 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 594/1229] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:37:12 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1339 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:37:13.654967 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-cbbad7a2-23db-4d47-8da0-05b7a97dc6ee req-1f9b3e21-cf54-4f25-b5b4-ea3479198afc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9faf5b6c-7f96-4a91-b944-fd72f5665f64", "tag": "4fac1673-dd2f-4368-bfcc-be873f33a32b"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:13.656832 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:37:13.656832 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:37:13.668358 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-cbbad7a2-23db-4d47-8da0-05b7a97dc6ee req-1f9b3e21-cf54-4f25-b5b4-ea3479198afc service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:13.668805 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-cbbad7a2-23db-4d47-8da0-05b7a97dc6ee req-1f9b3e21-cf54-4f25-b5b4-ea3479198afc service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:13.686057 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-cbbad7a2-23db-4d47-8da0-05b7a97dc6ee req-1f9b3e21-cf54-4f25-b5b4-ea3479198afc service nova] Creating event network-changed:4fac1673-dd2f-4368-bfcc-be873f33a32b for instance 9faf5b6c-7f96-4a91-b944-fd72f5665f64 on hv-cinder-81908 Dec 20 09:37:13.690513 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-cbbad7a2-23db-4d47-8da0-05b7a97dc6ee req-1f9b3e21-cf54-4f25-b5b4-ea3479198afc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039612 Dec 20 09:37:13.690513 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 636/1230] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:37:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:37:13.706964 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9c819231-12a2-4b24-b180-cf6409f451be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:13.708205 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9c819231-12a2-4b24-b180-cf6409f451be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:13.715546 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9c819231-12a2-4b24-b180-cf6409f451be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:13.717935 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9c819231-12a2-4b24-b180-cf6409f451be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:13.717935 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9c819231-12a2-4b24-b180-cf6409f451be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:13.717935 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9c819231-12a2-4b24-b180-cf6409f451be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:13.862377 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-9c819231-12a2-4b24-b180-cf6409f451be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:13.870477 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-9c819231-12a2-4b24-b180-cf6409f451be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:13.872065 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-9c819231-12a2-4b24-b180-cf6409f451be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:13.873184 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9c819231-12a2-4b24-b180-cf6409f451be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1407 microversion: 2.20 time: 0.170254 Dec 20 09:37:13.873751 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 595/1231] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:37:13 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:37:14.890549 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-36d17c14-34f9-44f1-add6-8ced12d5b579 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:14.891244 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-36d17c14-34f9-44f1-add6-8ced12d5b579 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:14.897304 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-36d17c14-34f9-44f1-add6-8ced12d5b579 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:14.897754 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-36d17c14-34f9-44f1-add6-8ced12d5b579 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:14.898526 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-36d17c14-34f9-44f1-add6-8ced12d5b579 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:14.898961 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-36d17c14-34f9-44f1-add6-8ced12d5b579 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:15.030803 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-36d17c14-34f9-44f1-add6-8ced12d5b579 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:15.038509 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-36d17c14-34f9-44f1-add6-8ced12d5b579 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:15.039968 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-36d17c14-34f9-44f1-add6-8ced12d5b579 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:15.041096 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-36d17c14-34f9-44f1-add6-8ced12d5b579 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1407 microversion: 2.20 time: 0.155032 Dec 20 09:37:15.041658 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 637/1232] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:37:14 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:37:16.059141 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e05a98f4-796c-4a14-bc21-9472a82dd626 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:16.059774 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e05a98f4-796c-4a14-bc21-9472a82dd626 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:16.066111 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e05a98f4-796c-4a14-bc21-9472a82dd626 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:16.066559 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e05a98f4-796c-4a14-bc21-9472a82dd626 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:16.067334 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e05a98f4-796c-4a14-bc21-9472a82dd626 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:16.067800 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e05a98f4-796c-4a14-bc21-9472a82dd626 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:16.195204 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e05a98f4-796c-4a14-bc21-9472a82dd626 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:16.203451 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e05a98f4-796c-4a14-bc21-9472a82dd626 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:16.204977 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e05a98f4-796c-4a14-bc21-9472a82dd626 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:16.206106 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e05a98f4-796c-4a14-bc21-9472a82dd626 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1407 microversion: 2.20 time: 0.150648 Dec 20 09:37:16.206666 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 596/1233] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:37:16 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:37:17.224005 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a169ac95-a4a6-4694-b7f0-633de0223891 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:17.224623 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a169ac95-a4a6-4694-b7f0-633de0223891 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:17.230849 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a169ac95-a4a6-4694-b7f0-633de0223891 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:17.231295 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a169ac95-a4a6-4694-b7f0-633de0223891 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:17.232104 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a169ac95-a4a6-4694-b7f0-633de0223891 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:17.232538 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a169ac95-a4a6-4694-b7f0-633de0223891 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:17.360028 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a169ac95-a4a6-4694-b7f0-633de0223891 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:17.368069 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a169ac95-a4a6-4694-b7f0-633de0223891 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:17.369899 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a169ac95-a4a6-4694-b7f0-633de0223891 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:17.371512 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a169ac95-a4a6-4694-b7f0-633de0223891 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1407 microversion: 2.20 time: 0.151270 Dec 20 09:37:17.372099 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 638/1234] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:37:17 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:37:18.389226 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d0d2008b-5bcc-4601-bae2-2241ca0ced7d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:18.389832 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d0d2008b-5bcc-4601-bae2-2241ca0ced7d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:18.396063 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d0d2008b-5bcc-4601-bae2-2241ca0ced7d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:18.396512 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d0d2008b-5bcc-4601-bae2-2241ca0ced7d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:18.397282 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d0d2008b-5bcc-4601-bae2-2241ca0ced7d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:18.397715 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d0d2008b-5bcc-4601-bae2-2241ca0ced7d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:18.526466 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d0d2008b-5bcc-4601-bae2-2241ca0ced7d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:18.534089 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d0d2008b-5bcc-4601-bae2-2241ca0ced7d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:18.535562 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d0d2008b-5bcc-4601-bae2-2241ca0ced7d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:18.536687 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d0d2008b-5bcc-4601-bae2-2241ca0ced7d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1407 microversion: 2.20 time: 0.151155 Dec 20 09:37:18.537242 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 597/1235] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:37:18 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:37:19.554111 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-47738848-06fc-4c31-833f-615812f6cd09 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:19.554713 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-47738848-06fc-4c31-833f-615812f6cd09 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:19.561640 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-47738848-06fc-4c31-833f-615812f6cd09 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:19.562087 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-47738848-06fc-4c31-833f-615812f6cd09 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:19.562862 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-47738848-06fc-4c31-833f-615812f6cd09 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:19.563297 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-47738848-06fc-4c31-833f-615812f6cd09 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:19.699275 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-47738848-06fc-4c31-833f-615812f6cd09 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:19.707157 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-47738848-06fc-4c31-833f-615812f6cd09 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:19.708716 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-47738848-06fc-4c31-833f-615812f6cd09 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:19.709825 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-47738848-06fc-4c31-833f-615812f6cd09 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1407 microversion: 2.20 time: 0.159459 Dec 20 09:37:19.710533 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 639/1236] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:37:19 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:37:20.298742 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-0ed34e1e-c3e3-46d9-a4c4-8552afb28a43 req-a80aae7a-b696-43d2-9186-281c96009042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9faf5b6c-7f96-4a91-b944-fd72f5665f64", "name": "network-vif-plugged", "status": "completed", "tag": "4fac1673-dd2f-4368-bfcc-be873f33a32b"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:20.298742 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:37:20.298742 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:37:20.302511 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-0ed34e1e-c3e3-46d9-a4c4-8552afb28a43 req-a80aae7a-b696-43d2-9186-281c96009042 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:20.302948 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-0ed34e1e-c3e3-46d9-a4c4-8552afb28a43 req-a80aae7a-b696-43d2-9186-281c96009042 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:20.314231 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-0ed34e1e-c3e3-46d9-a4c4-8552afb28a43 req-a80aae7a-b696-43d2-9186-281c96009042 service nova] Creating event network-vif-plugged:4fac1673-dd2f-4368-bfcc-be873f33a32b for instance 9faf5b6c-7f96-4a91-b944-fd72f5665f64 on hv-cinder-81908 Dec 20 09:37:20.319050 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-0ed34e1e-c3e3-46d9-a4c4-8552afb28a43 req-a80aae7a-b696-43d2-9186-281c96009042 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029540 Dec 20 09:37:20.319605 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 598/1237] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:37:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:37:20.728431 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3d7cb7d1-e3c5-4d77-be2c-c4e505874a84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:20.729059 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-3d7cb7d1-e3c5-4d77-be2c-c4e505874a84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:20.735353 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3d7cb7d1-e3c5-4d77-be2c-c4e505874a84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:20.735844 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3d7cb7d1-e3c5-4d77-be2c-c4e505874a84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:20.736625 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3d7cb7d1-e3c5-4d77-be2c-c4e505874a84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:20.737057 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3d7cb7d1-e3c5-4d77-be2c-c4e505874a84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:20.864031 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3d7cb7d1-e3c5-4d77-be2c-c4e505874a84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:20.872250 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3d7cb7d1-e3c5-4d77-be2c-c4e505874a84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:20.873785 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3d7cb7d1-e3c5-4d77-be2c-c4e505874a84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:20.874935 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3d7cb7d1-e3c5-4d77-be2c-c4e505874a84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1407 microversion: 2.20 time: 0.150243 Dec 20 09:37:20.875503 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 640/1238] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:37:20 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:37:21.894004 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e2c6527f-b57d-452a-ae4f-4bf447f7bda0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:21.894708 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e2c6527f-b57d-452a-ae4f-4bf447f7bda0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:21.900885 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e2c6527f-b57d-452a-ae4f-4bf447f7bda0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:21.901337 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e2c6527f-b57d-452a-ae4f-4bf447f7bda0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:21.902110 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e2c6527f-b57d-452a-ae4f-4bf447f7bda0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:21.902549 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e2c6527f-b57d-452a-ae4f-4bf447f7bda0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:22.032945 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e2c6527f-b57d-452a-ae4f-4bf447f7bda0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:22.040472 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e2c6527f-b57d-452a-ae4f-4bf447f7bda0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:22.041938 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e2c6527f-b57d-452a-ae4f-4bf447f7bda0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:22.043022 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e2c6527f-b57d-452a-ae4f-4bf447f7bda0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1407 microversion: 2.20 time: 0.153615 Dec 20 09:37:22.043585 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 599/1239] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:37:21 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:37:23.060229 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-197cc889-d203-4dcb-8979-14a6b186ccf5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:23.060856 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-197cc889-d203-4dcb-8979-14a6b186ccf5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:23.067103 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-197cc889-d203-4dcb-8979-14a6b186ccf5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:23.067542 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-197cc889-d203-4dcb-8979-14a6b186ccf5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:23.068670 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-197cc889-d203-4dcb-8979-14a6b186ccf5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:23.069114 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-197cc889-d203-4dcb-8979-14a6b186ccf5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:23.202891 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-197cc889-d203-4dcb-8979-14a6b186ccf5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:23.210653 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-197cc889-d203-4dcb-8979-14a6b186ccf5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:23.212155 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-197cc889-d203-4dcb-8979-14a6b186ccf5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:37:23.213307 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-197cc889-d203-4dcb-8979-14a6b186ccf5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1599 microversion: 2.20 time: 0.157462 Dec 20 09:37:23.213873 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 641/1240] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:37:23 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:37:23.230554 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6feb4b9f-9200-4b6e-90a1-fbcadd39a039 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:37:23.231074 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6feb4b9f-9200-4b6e-90a1-fbcadd39a039 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:23.237470 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6feb4b9f-9200-4b6e-90a1-fbcadd39a039 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:23.237923 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6feb4b9f-9200-4b6e-90a1-fbcadd39a039 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:23.238704 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6feb4b9f-9200-4b6e-90a1-fbcadd39a039 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:23.239144 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6feb4b9f-9200-4b6e-90a1-fbcadd39a039 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:23.318031 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6feb4b9f-9200-4b6e-90a1-fbcadd39a039 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091595 Dec 20 09:37:23.318676 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 600/1241] 10.222.0.62 () {60 vars in 1315 bytes} [Mon Dec 20 09:37:23 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:37:24.293062 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-88261529-c0ad-4a58-8b6d-55b573ea3fbd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:24.298839 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-8f4e28ff-31c4-4cba-911a-44ce80bc3849 req-dee1bbad-4a38-467a-b819-ded8f92a8998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9faf5b6c-7f96-4a91-b944-fd72f5665f64", "tag": "4fac1673-dd2f-4368-bfcc-be873f33a32b"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:24.301074 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:37:24.301074 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:37:24.303708 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-88261529-c0ad-4a58-8b6d-55b573ea3fbd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:24.308571 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-8f4e28ff-31c4-4cba-911a-44ce80bc3849 req-dee1bbad-4a38-467a-b819-ded8f92a8998 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:24.311026 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-8f4e28ff-31c4-4cba-911a-44ce80bc3849 req-dee1bbad-4a38-467a-b819-ded8f92a8998 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:24.311136 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-88261529-c0ad-4a58-8b6d-55b573ea3fbd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:24.311136 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-88261529-c0ad-4a58-8b6d-55b573ea3fbd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:24.311507 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-88261529-c0ad-4a58-8b6d-55b573ea3fbd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:24.311699 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-88261529-c0ad-4a58-8b6d-55b573ea3fbd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:24.320518 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-8f4e28ff-31c4-4cba-911a-44ce80bc3849 req-dee1bbad-4a38-467a-b819-ded8f92a8998 service nova] Creating event network-changed:4fac1673-dd2f-4368-bfcc-be873f33a32b for instance 9faf5b6c-7f96-4a91-b944-fd72f5665f64 on hv-cinder-81908 Dec 20 09:37:24.325445 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-8f4e28ff-31c4-4cba-911a-44ce80bc3849 req-dee1bbad-4a38-467a-b819-ded8f92a8998 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030661 Dec 20 09:37:24.326039 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 601/1242] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:37:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:37:24.383630 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-88261529-c0ad-4a58-8b6d-55b573ea3fbd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 14 microversion: 2.20 time: 0.094769 Dec 20 09:37:24.384476 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 642/1243] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:24 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:37:25.395726 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-23884341-4c28-40b0-866b-4e04fa0526a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:25.396754 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-23884341-4c28-40b0-866b-4e04fa0526a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:25.402850 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-23884341-4c28-40b0-866b-4e04fa0526a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:25.403297 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-23884341-4c28-40b0-866b-4e04fa0526a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:25.404097 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-23884341-4c28-40b0-866b-4e04fa0526a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:25.404539 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-23884341-4c28-40b0-866b-4e04fa0526a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:25.467309 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-23884341-4c28-40b0-866b-4e04fa0526a5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 14 microversion: 2.20 time: 0.076270 Dec 20 09:37:25.467967 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 602/1244] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:25 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:37:26.478612 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-24d0c2cf-ce00-440b-b06c-f9c722c36746 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:26.479532 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-24d0c2cf-ce00-440b-b06c-f9c722c36746 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:26.486391 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-24d0c2cf-ce00-440b-b06c-f9c722c36746 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:26.486831 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-24d0c2cf-ce00-440b-b06c-f9c722c36746 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:26.487621 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-24d0c2cf-ce00-440b-b06c-f9c722c36746 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:26.488074 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-24d0c2cf-ce00-440b-b06c-f9c722c36746 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:26.549921 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-24d0c2cf-ce00-440b-b06c-f9c722c36746 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 14 microversion: 2.20 time: 0.075297 Dec 20 09:37:26.550523 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 643/1245] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:26 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:37:27.561853 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f18bd3bb-f858-41fd-986e-232cf636b39c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:27.562760 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f18bd3bb-f858-41fd-986e-232cf636b39c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:27.569552 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f18bd3bb-f858-41fd-986e-232cf636b39c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:27.569994 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f18bd3bb-f858-41fd-986e-232cf636b39c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:27.570757 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f18bd3bb-f858-41fd-986e-232cf636b39c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:27.571186 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f18bd3bb-f858-41fd-986e-232cf636b39c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:27.653628 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f18bd3bb-f858-41fd-986e-232cf636b39c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 14 microversion: 2.20 time: 0.096385 Dec 20 09:37:27.654238 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 603/1246] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:27 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:37:28.664999 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d1330678-abf9-4a43-9847-c9bf50379e29 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:28.666005 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d1330678-abf9-4a43-9847-c9bf50379e29 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:28.672838 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d1330678-abf9-4a43-9847-c9bf50379e29 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:28.673287 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d1330678-abf9-4a43-9847-c9bf50379e29 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:28.674060 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d1330678-abf9-4a43-9847-c9bf50379e29 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:28.674493 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d1330678-abf9-4a43-9847-c9bf50379e29 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:28.749255 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d1330678-abf9-4a43-9847-c9bf50379e29 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 14 microversion: 2.20 time: 0.088250 Dec 20 09:37:28.749854 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 644/1247] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:28 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:37:29.761590 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-428dca60-63e9-48b8-a027-53ef733617eb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:29.762493 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-428dca60-63e9-48b8-a027-53ef733617eb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:29.769313 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-428dca60-63e9-48b8-a027-53ef733617eb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:29.769757 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-428dca60-63e9-48b8-a027-53ef733617eb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:29.770518 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-428dca60-63e9-48b8-a027-53ef733617eb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:29.770948 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-428dca60-63e9-48b8-a027-53ef733617eb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:29.833615 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-428dca60-63e9-48b8-a027-53ef733617eb tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 14 microversion: 2.20 time: 0.076554 Dec 20 09:37:29.834202 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 604/1248] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:29 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:37:30.846382 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3a78464e-a529-44c8-9128-56cffe8d86f4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:30.847518 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-3a78464e-a529-44c8-9128-56cffe8d86f4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:30.853933 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3a78464e-a529-44c8-9128-56cffe8d86f4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:30.855010 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3a78464e-a529-44c8-9128-56cffe8d86f4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:30.855889 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3a78464e-a529-44c8-9128-56cffe8d86f4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:30.856325 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3a78464e-a529-44c8-9128-56cffe8d86f4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:30.921734 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3a78464e-a529-44c8-9128-56cffe8d86f4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 14 microversion: 2.20 time: 0.080194 Dec 20 09:37:30.922368 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 645/1249] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:30 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:37:31.933607 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-7a68716c-7d54-448c-8db5-4542fabe2d26 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:31.934638 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-7a68716c-7d54-448c-8db5-4542fabe2d26 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:31.941669 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7a68716c-7d54-448c-8db5-4542fabe2d26 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:31.942121 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7a68716c-7d54-448c-8db5-4542fabe2d26 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:31.942902 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7a68716c-7d54-448c-8db5-4542fabe2d26 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:31.943339 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7a68716c-7d54-448c-8db5-4542fabe2d26 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:32.011049 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-7a68716c-7d54-448c-8db5-4542fabe2d26 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 14 microversion: 2.20 time: 0.080843 Dec 20 09:37:32.011649 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 605/1250] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:31 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:37:33.021956 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-78b5b0ce-5f08-4b11-990b-10957923492b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:33.023032 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-78b5b0ce-5f08-4b11-990b-10957923492b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:33.030091 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-78b5b0ce-5f08-4b11-990b-10957923492b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:33.030533 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-78b5b0ce-5f08-4b11-990b-10957923492b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:33.031328 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-78b5b0ce-5f08-4b11-990b-10957923492b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:33.031801 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-78b5b0ce-5f08-4b11-990b-10957923492b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:33.125465 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-78b5b0ce-5f08-4b11-990b-10957923492b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 14 microversion: 2.20 time: 0.107472 Dec 20 09:37:33.126240 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 646/1251] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:33 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:37:34.136935 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a8879bab-0edd-4995-86b1-e32e94d3d0f9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:34.137938 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a8879bab-0edd-4995-86b1-e32e94d3d0f9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:34.144848 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a8879bab-0edd-4995-86b1-e32e94d3d0f9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:34.145296 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a8879bab-0edd-4995-86b1-e32e94d3d0f9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:34.146067 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a8879bab-0edd-4995-86b1-e32e94d3d0f9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:34.146505 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a8879bab-0edd-4995-86b1-e32e94d3d0f9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:34.210373 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a8879bab-0edd-4995-86b1-e32e94d3d0f9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 14 microversion: 2.20 time: 0.077404 Dec 20 09:37:34.210982 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 606/1252] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:34 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:37:35.222348 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9cb72e7a-d087-42af-add0-3c54fc5603bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:35.223357 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9cb72e7a-d087-42af-add0-3c54fc5603bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:35.230858 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9cb72e7a-d087-42af-add0-3c54fc5603bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:35.231304 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9cb72e7a-d087-42af-add0-3c54fc5603bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:35.232121 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9cb72e7a-d087-42af-add0-3c54fc5603bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:35.232554 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9cb72e7a-d087-42af-add0-3c54fc5603bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:35.294422 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9cb72e7a-d087-42af-add0-3c54fc5603bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 14 microversion: 2.20 time: 0.076043 Dec 20 09:37:35.295200 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 647/1253] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:35 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:37:36.305737 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a374c879-956e-4a3d-b019-37daadb8420c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:36.306747 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a374c879-956e-4a3d-b019-37daadb8420c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:36.314176 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a374c879-956e-4a3d-b019-37daadb8420c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:36.314631 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a374c879-956e-4a3d-b019-37daadb8420c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:36.315406 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a374c879-956e-4a3d-b019-37daadb8420c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:36.315908 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a374c879-956e-4a3d-b019-37daadb8420c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:36.390412 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a374c879-956e-4a3d-b019-37daadb8420c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 3200 microversion: 2.20 time: 0.088700 Dec 20 09:37:36.391025 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 607/1254] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:36 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 3200 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:37:37.402021 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ac24eb08-aa09-4de9-9f4f-9c31fa29af95 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:37.403032 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ac24eb08-aa09-4de9-9f4f-9c31fa29af95 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:37.410080 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac24eb08-aa09-4de9-9f4f-9c31fa29af95 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:37.410533 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac24eb08-aa09-4de9-9f4f-9c31fa29af95 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:37.411320 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac24eb08-aa09-4de9-9f4f-9c31fa29af95 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:37.411896 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac24eb08-aa09-4de9-9f4f-9c31fa29af95 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:37.487142 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ac24eb08-aa09-4de9-9f4f-9c31fa29af95 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 13888 microversion: 2.20 time: 0.089102 Dec 20 09:37:37.487794 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 648/1255] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:37 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 13888 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:37:38.499054 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-7928169d-9ed1-49d3-9fc5-41503444a603 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:38.500091 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-7928169d-9ed1-49d3-9fc5-41503444a603 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:38.507012 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7928169d-9ed1-49d3-9fc5-41503444a603 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:38.507465 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7928169d-9ed1-49d3-9fc5-41503444a603 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:38.508276 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7928169d-9ed1-49d3-9fc5-41503444a603 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:38.508715 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7928169d-9ed1-49d3-9fc5-41503444a603 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:38.579173 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-7928169d-9ed1-49d3-9fc5-41503444a603 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 18449 microversion: 2.20 time: 0.084552 Dec 20 09:37:38.579969 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 608/1256] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:38 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 18449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:37:39.591509 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4a4226cb-c581-4f3f-a9db-73a244803f47 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:39.592544 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-4a4226cb-c581-4f3f-a9db-73a244803f47 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:39.599366 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4a4226cb-c581-4f3f-a9db-73a244803f47 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:39.599851 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4a4226cb-c581-4f3f-a9db-73a244803f47 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:39.600634 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4a4226cb-c581-4f3f-a9db-73a244803f47 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:39.601073 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4a4226cb-c581-4f3f-a9db-73a244803f47 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:39.676001 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-4a4226cb-c581-4f3f-a9db-73a244803f47 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 19342 microversion: 2.20 time: 0.088953 Dec 20 09:37:39.676582 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 649/1257] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:39 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 19342 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:37:40.688187 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1137c26d-b5fa-423b-80b2-3b1091ff2092 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:40.689183 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1137c26d-b5fa-423b-80b2-3b1091ff2092 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:40.696039 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1137c26d-b5fa-423b-80b2-3b1091ff2092 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:40.696494 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1137c26d-b5fa-423b-80b2-3b1091ff2092 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:40.697262 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1137c26d-b5fa-423b-80b2-3b1091ff2092 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:40.698349 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1137c26d-b5fa-423b-80b2-3b1091ff2092 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:40.780775 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1137c26d-b5fa-423b-80b2-3b1091ff2092 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 21344 microversion: 2.20 time: 0.096617 Dec 20 09:37:40.781398 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 609/1258] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:40 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 21344 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:37:41.793334 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-71f514a4-f501-420e-b5c3-aa7e82e17418 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:41.794368 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-71f514a4-f501-420e-b5c3-aa7e82e17418 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:41.801301 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-71f514a4-f501-420e-b5c3-aa7e82e17418 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:41.801750 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-71f514a4-f501-420e-b5c3-aa7e82e17418 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:41.802528 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-71f514a4-f501-420e-b5c3-aa7e82e17418 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:41.802960 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-71f514a4-f501-420e-b5c3-aa7e82e17418 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:41.882301 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-71f514a4-f501-420e-b5c3-aa7e82e17418 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 23045 microversion: 2.20 time: 0.093439 Dec 20 09:37:41.882919 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 650/1259] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:41 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 23045 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:37:42.893402 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ba09da62-ce86-4d2b-b0d9-e972aa377ef1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:42.894427 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ba09da62-ce86-4d2b-b0d9-e972aa377ef1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:42.901491 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ba09da62-ce86-4d2b-b0d9-e972aa377ef1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:42.901936 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ba09da62-ce86-4d2b-b0d9-e972aa377ef1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:42.902710 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ba09da62-ce86-4d2b-b0d9-e972aa377ef1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:42.903143 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ba09da62-ce86-4d2b-b0d9-e972aa377ef1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:42.988089 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ba09da62-ce86-4d2b-b0d9-e972aa377ef1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 24114 microversion: 2.20 time: 0.098525 Dec 20 09:37:42.989039 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 610/1260] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:42 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 24114 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:37:44.000948 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f2f6f83d-24df-4e6c-afda-af7b7f1f0dd9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:44.001965 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f2f6f83d-24df-4e6c-afda-af7b7f1f0dd9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:44.008883 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f2f6f83d-24df-4e6c-afda-af7b7f1f0dd9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:44.010480 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f2f6f83d-24df-4e6c-afda-af7b7f1f0dd9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:44.010480 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f2f6f83d-24df-4e6c-afda-af7b7f1f0dd9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:44.010699 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f2f6f83d-24df-4e6c-afda-af7b7f1f0dd9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:44.090594 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f2f6f83d-24df-4e6c-afda-af7b7f1f0dd9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 25575 microversion: 2.20 time: 0.093568 Dec 20 09:37:44.091254 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 651/1261] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:43 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 25575 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:37:45.102441 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e8f9efac-af45-47b6-a6bf-52ef2862e120 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:45.103426 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e8f9efac-af45-47b6-a6bf-52ef2862e120 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:45.110816 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e8f9efac-af45-47b6-a6bf-52ef2862e120 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:45.111258 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e8f9efac-af45-47b6-a6bf-52ef2862e120 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:45.112053 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e8f9efac-af45-47b6-a6bf-52ef2862e120 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:45.112489 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e8f9efac-af45-47b6-a6bf-52ef2862e120 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:45.204154 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e8f9efac-af45-47b6-a6bf-52ef2862e120 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 26891 microversion: 2.20 time: 0.105509 Dec 20 09:37:45.204713 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 611/1262] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:45 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 26891 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:37:46.216599 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-057515e2-37ca-4ba8-8537-86b50b95cab0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:46.217628 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-057515e2-37ca-4ba8-8537-86b50b95cab0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:46.224569 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-057515e2-37ca-4ba8-8537-86b50b95cab0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:46.225016 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-057515e2-37ca-4ba8-8537-86b50b95cab0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:46.225812 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-057515e2-37ca-4ba8-8537-86b50b95cab0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:46.226249 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-057515e2-37ca-4ba8-8537-86b50b95cab0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:46.313658 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-057515e2-37ca-4ba8-8537-86b50b95cab0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 27630 microversion: 2.20 time: 0.099558 Dec 20 09:37:46.313658 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 652/1263] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:46 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 27630 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:37:47.324394 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a1fbeef5-0df2-4a3a-a4ca-f4f2fe0bb0dd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:47.325390 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a1fbeef5-0df2-4a3a-a4ca-f4f2fe0bb0dd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:47.332198 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a1fbeef5-0df2-4a3a-a4ca-f4f2fe0bb0dd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:47.347114 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a1fbeef5-0df2-4a3a-a4ca-f4f2fe0bb0dd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:47.347114 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a1fbeef5-0df2-4a3a-a4ca-f4f2fe0bb0dd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:47.347114 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a1fbeef5-0df2-4a3a-a4ca-f4f2fe0bb0dd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:47.428512 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a1fbeef5-0df2-4a3a-a4ca-f4f2fe0bb0dd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 27883 microversion: 2.20 time: 0.108709 Dec 20 09:37:47.429183 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 612/1264] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:47 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 27883 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:37:48.442660 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9a85dbb9-9bdd-4b6c-9c27-f132666fbcab tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:48.443702 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9a85dbb9-9bdd-4b6c-9c27-f132666fbcab tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:48.451063 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9a85dbb9-9bdd-4b6c-9c27-f132666fbcab tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:48.451499 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9a85dbb9-9bdd-4b6c-9c27-f132666fbcab tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:48.452301 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9a85dbb9-9bdd-4b6c-9c27-f132666fbcab tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:48.452729 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9a85dbb9-9bdd-4b6c-9c27-f132666fbcab tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:48.530911 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9a85dbb9-9bdd-4b6c-9c27-f132666fbcab tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28176 microversion: 2.20 time: 0.092161 Dec 20 09:37:48.531561 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 653/1265] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:48 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28176 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:37:49.543097 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-40ba9434-d59a-4a63-b99a-83abcb316ca9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:49.544142 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-40ba9434-d59a-4a63-b99a-83abcb316ca9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:49.550910 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-40ba9434-d59a-4a63-b99a-83abcb316ca9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:49.551356 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-40ba9434-d59a-4a63-b99a-83abcb316ca9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:49.552157 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-40ba9434-d59a-4a63-b99a-83abcb316ca9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:49.552585 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-40ba9434-d59a-4a63-b99a-83abcb316ca9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:49.613776 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-40ba9434-d59a-4a63-b99a-83abcb316ca9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28176 microversion: 2.20 time: 0.074766 Dec 20 09:37:49.614405 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 613/1266] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:49 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28176 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:37:50.625970 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c086598e-ed64-45b2-824f-123cd60c9b96 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:50.626901 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c086598e-ed64-45b2-824f-123cd60c9b96 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:50.633895 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c086598e-ed64-45b2-824f-123cd60c9b96 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:50.634343 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c086598e-ed64-45b2-824f-123cd60c9b96 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:50.635127 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c086598e-ed64-45b2-824f-123cd60c9b96 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:50.635593 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c086598e-ed64-45b2-824f-123cd60c9b96 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:50.705234 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c086598e-ed64-45b2-824f-123cd60c9b96 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28176 microversion: 2.20 time: 0.083299 Dec 20 09:37:50.706018 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 654/1267] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:50 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28176 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:37:51.718693 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-bef6cf08-b48f-44ed-902d-364273666c66 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:51.719617 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-bef6cf08-b48f-44ed-902d-364273666c66 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:51.726760 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bef6cf08-b48f-44ed-902d-364273666c66 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:51.727212 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bef6cf08-b48f-44ed-902d-364273666c66 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:51.728020 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bef6cf08-b48f-44ed-902d-364273666c66 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:51.728488 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bef6cf08-b48f-44ed-902d-364273666c66 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:51.800631 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-bef6cf08-b48f-44ed-902d-364273666c66 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28176 microversion: 2.20 time: 0.086035 Dec 20 09:37:51.801254 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 614/1268] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:51 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28176 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:37:52.813689 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f3b7f004-c0bf-41e4-938a-0c6798d61ec0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:52.814691 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f3b7f004-c0bf-41e4-938a-0c6798d61ec0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:52.821613 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f3b7f004-c0bf-41e4-938a-0c6798d61ec0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:52.822063 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f3b7f004-c0bf-41e4-938a-0c6798d61ec0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:52.822843 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f3b7f004-c0bf-41e4-938a-0c6798d61ec0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:52.823280 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f3b7f004-c0bf-41e4-938a-0c6798d61ec0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:52.889332 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f3b7f004-c0bf-41e4-938a-0c6798d61ec0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28176 microversion: 2.20 time: 0.080386 Dec 20 09:37:52.890253 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 655/1269] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:52 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28176 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:37:53.903127 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-291daafa-22b3-4fe6-bb82-5017094048be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:53.904156 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-291daafa-22b3-4fe6-bb82-5017094048be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:53.910995 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-291daafa-22b3-4fe6-bb82-5017094048be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:53.911441 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-291daafa-22b3-4fe6-bb82-5017094048be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:53.912246 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-291daafa-22b3-4fe6-bb82-5017094048be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:53.912686 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-291daafa-22b3-4fe6-bb82-5017094048be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:53.975858 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-291daafa-22b3-4fe6-bb82-5017094048be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28176 microversion: 2.20 time: 0.076671 Dec 20 09:37:53.976518 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 615/1270] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:53 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28176 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:37:54.988546 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7ebe39f1-49b5-4485-9902-d6c35df43ff9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:54.989580 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7ebe39f1-49b5-4485-9902-d6c35df43ff9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:54.996718 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7ebe39f1-49b5-4485-9902-d6c35df43ff9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:54.997169 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7ebe39f1-49b5-4485-9902-d6c35df43ff9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:54.997952 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7ebe39f1-49b5-4485-9902-d6c35df43ff9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:54.998390 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7ebe39f1-49b5-4485-9902-d6c35df43ff9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:55.069011 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7ebe39f1-49b5-4485-9902-d6c35df43ff9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28176 microversion: 2.20 time: 0.084512 Dec 20 09:37:55.069637 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 656/1271] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:54 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28176 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:37:56.081198 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a1dff61d-722d-4bea-9c0e-037e721eff85 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:56.082200 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a1dff61d-722d-4bea-9c0e-037e721eff85 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:56.089013 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a1dff61d-722d-4bea-9c0e-037e721eff85 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:56.089472 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a1dff61d-722d-4bea-9c0e-037e721eff85 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:56.090246 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a1dff61d-722d-4bea-9c0e-037e721eff85 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:56.090687 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a1dff61d-722d-4bea-9c0e-037e721eff85 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:56.151354 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a1dff61d-722d-4bea-9c0e-037e721eff85 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28176 microversion: 2.20 time: 0.074084 Dec 20 09:37:56.152007 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 616/1272] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:56 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28176 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:37:57.162986 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8f291d16-3995-4d8d-8222-62576377b672 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:57.164020 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-8f291d16-3995-4d8d-8222-62576377b672 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:57.170972 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8f291d16-3995-4d8d-8222-62576377b672 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:57.171444 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8f291d16-3995-4d8d-8222-62576377b672 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:57.172239 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8f291d16-3995-4d8d-8222-62576377b672 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:57.172713 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8f291d16-3995-4d8d-8222-62576377b672 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:57.232670 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8f291d16-3995-4d8d-8222-62576377b672 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28176 microversion: 2.20 time: 0.073754 Dec 20 09:37:57.233475 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 657/1273] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:57 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28176 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:37:58.245124 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f611a5c3-5c2b-4575-a93a-84a00b1f69e0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:58.246153 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f611a5c3-5c2b-4575-a93a-84a00b1f69e0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:58.253048 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f611a5c3-5c2b-4575-a93a-84a00b1f69e0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:58.253503 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f611a5c3-5c2b-4575-a93a-84a00b1f69e0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:58.254279 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f611a5c3-5c2b-4575-a93a-84a00b1f69e0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:58.254720 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f611a5c3-5c2b-4575-a93a-84a00b1f69e0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:58.328789 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f611a5c3-5c2b-4575-a93a-84a00b1f69e0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28176 microversion: 2.20 time: 0.088002 Dec 20 09:37:58.329663 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 617/1274] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:58 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28176 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:37:59.341480 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-17d8283a-d2b2-4349-b6fa-7d573bbb0c94 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:37:59.342510 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-17d8283a-d2b2-4349-b6fa-7d573bbb0c94 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:37:59.349476 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-17d8283a-d2b2-4349-b6fa-7d573bbb0c94 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:59.349924 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-17d8283a-d2b2-4349-b6fa-7d573bbb0c94 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:59.350702 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-17d8283a-d2b2-4349-b6fa-7d573bbb0c94 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:37:59.351142 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-17d8283a-d2b2-4349-b6fa-7d573bbb0c94 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:37:59.418461 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-17d8283a-d2b2-4349-b6fa-7d573bbb0c94 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28176 microversion: 2.20 time: 0.081434 Dec 20 09:37:59.419147 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 658/1275] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:37:59 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28176 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:00.430643 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8c27909d-15e0-4d0c-be12-d0532a2dfe17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:00.431671 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8c27909d-15e0-4d0c-be12-d0532a2dfe17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:00.438689 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8c27909d-15e0-4d0c-be12-d0532a2dfe17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:00.439132 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8c27909d-15e0-4d0c-be12-d0532a2dfe17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:00.439927 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8c27909d-15e0-4d0c-be12-d0532a2dfe17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:00.440360 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8c27909d-15e0-4d0c-be12-d0532a2dfe17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:00.506378 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8c27909d-15e0-4d0c-be12-d0532a2dfe17 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28176 microversion: 2.20 time: 0.079748 Dec 20 09:38:00.507279 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 618/1276] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:00 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28176 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:01.518878 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ee156768-8add-4cc2-9cb9-0b5e086180bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:01.519973 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ee156768-8add-4cc2-9cb9-0b5e086180bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:01.527022 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ee156768-8add-4cc2-9cb9-0b5e086180bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:01.527465 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ee156768-8add-4cc2-9cb9-0b5e086180bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:01.528275 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ee156768-8add-4cc2-9cb9-0b5e086180bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:01.528706 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ee156768-8add-4cc2-9cb9-0b5e086180bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:01.590129 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ee156768-8add-4cc2-9cb9-0b5e086180bc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28176 microversion: 2.20 time: 0.075165 Dec 20 09:38:01.590766 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 659/1277] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:01 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28176 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:02.601693 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-31cbdf76-d743-41e9-9a20-e6b6d4a73902 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:02.602623 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-31cbdf76-d743-41e9-9a20-e6b6d4a73902 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:02.609528 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-31cbdf76-d743-41e9-9a20-e6b6d4a73902 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:02.609979 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-31cbdf76-d743-41e9-9a20-e6b6d4a73902 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:02.610758 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-31cbdf76-d743-41e9-9a20-e6b6d4a73902 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:02.611193 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-31cbdf76-d743-41e9-9a20-e6b6d4a73902 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:02.673234 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-31cbdf76-d743-41e9-9a20-e6b6d4a73902 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28176 microversion: 2.20 time: 0.075705 Dec 20 09:38:02.673859 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 619/1278] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:02 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28176 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:03.686241 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9875f75f-98e8-4e96-9bd5-a8a704637a23 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:03.687176 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9875f75f-98e8-4e96-9bd5-a8a704637a23 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:03.694321 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9875f75f-98e8-4e96-9bd5-a8a704637a23 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:03.694772 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9875f75f-98e8-4e96-9bd5-a8a704637a23 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:03.695552 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9875f75f-98e8-4e96-9bd5-a8a704637a23 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:03.696017 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9875f75f-98e8-4e96-9bd5-a8a704637a23 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:03.772942 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9875f75f-98e8-4e96-9bd5-a8a704637a23 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28176 microversion: 2.20 time: 0.091266 Dec 20 09:38:03.773662 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 660/1279] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:03 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28176 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:04.784507 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b790d20d-b24b-4f97-bbd1-05c6d8308bc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:04.785512 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b790d20d-b24b-4f97-bbd1-05c6d8308bc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:04.792360 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b790d20d-b24b-4f97-bbd1-05c6d8308bc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:04.792821 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b790d20d-b24b-4f97-bbd1-05c6d8308bc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:04.793590 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b790d20d-b24b-4f97-bbd1-05c6d8308bc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:04.794022 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b790d20d-b24b-4f97-bbd1-05c6d8308bc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:04.857295 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b790d20d-b24b-4f97-bbd1-05c6d8308bc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28176 microversion: 2.20 time: 0.076833 Dec 20 09:38:04.857917 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 620/1280] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:04 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28176 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:05.871879 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-07fe653d-ed59-4e86-a6f2-80e95c605552 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:05.872795 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-07fe653d-ed59-4e86-a6f2-80e95c605552 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:05.880515 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-07fe653d-ed59-4e86-a6f2-80e95c605552 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:05.880963 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-07fe653d-ed59-4e86-a6f2-80e95c605552 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:05.881750 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-07fe653d-ed59-4e86-a6f2-80e95c605552 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:05.882187 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-07fe653d-ed59-4e86-a6f2-80e95c605552 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:05.955143 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-07fe653d-ed59-4e86-a6f2-80e95c605552 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28176 microversion: 2.20 time: 0.088740 Dec 20 09:38:05.955795 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 661/1281] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:05 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28176 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:06.967237 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8c2ad8ba-f0a7-4bf2-ab91-1b643aeb8f30 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:06.968257 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8c2ad8ba-f0a7-4bf2-ab91-1b643aeb8f30 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:06.975330 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8c2ad8ba-f0a7-4bf2-ab91-1b643aeb8f30 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:06.975813 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8c2ad8ba-f0a7-4bf2-ab91-1b643aeb8f30 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:06.976599 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8c2ad8ba-f0a7-4bf2-ab91-1b643aeb8f30 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:06.977037 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8c2ad8ba-f0a7-4bf2-ab91-1b643aeb8f30 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:07.042399 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8c2ad8ba-f0a7-4bf2-ab91-1b643aeb8f30 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28176 microversion: 2.20 time: 0.079053 Dec 20 09:38:07.043028 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 621/1282] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:06 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28176 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:08.054432 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-63b50383-1a6b-4fe2-b990-3036e266e7d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:08.055437 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-63b50383-1a6b-4fe2-b990-3036e266e7d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:08.062886 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-63b50383-1a6b-4fe2-b990-3036e266e7d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:08.063334 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-63b50383-1a6b-4fe2-b990-3036e266e7d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:08.064140 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-63b50383-1a6b-4fe2-b990-3036e266e7d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:08.064576 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-63b50383-1a6b-4fe2-b990-3036e266e7d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:08.129118 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-63b50383-1a6b-4fe2-b990-3036e266e7d0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28176 microversion: 2.20 time: 0.078542 Dec 20 09:38:08.129778 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 662/1283] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:08 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28176 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:09.141124 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a03e9c6b-95d6-4e33-884e-61c4b9050c11 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:09.142121 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a03e9c6b-95d6-4e33-884e-61c4b9050c11 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:09.148997 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a03e9c6b-95d6-4e33-884e-61c4b9050c11 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:09.149977 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a03e9c6b-95d6-4e33-884e-61c4b9050c11 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:09.150745 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a03e9c6b-95d6-4e33-884e-61c4b9050c11 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:09.151179 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a03e9c6b-95d6-4e33-884e-61c4b9050c11 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:09.235526 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a03e9c6b-95d6-4e33-884e-61c4b9050c11 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28467 microversion: 2.20 time: 0.098337 Dec 20 09:38:09.236458 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 622/1284] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:09 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28467 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:10.247455 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-fa63fc37-ef8a-412a-95ca-55471a6ca397 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:10.248484 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-fa63fc37-ef8a-412a-95ca-55471a6ca397 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:10.255269 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fa63fc37-ef8a-412a-95ca-55471a6ca397 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:10.255739 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fa63fc37-ef8a-412a-95ca-55471a6ca397 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:10.256542 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fa63fc37-ef8a-412a-95ca-55471a6ca397 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:10.256977 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fa63fc37-ef8a-412a-95ca-55471a6ca397 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:10.324701 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-fa63fc37-ef8a-412a-95ca-55471a6ca397 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28467 microversion: 2.20 time: 0.081211 Dec 20 09:38:10.325575 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 663/1285] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:10 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28467 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:11.336596 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-31dfcd4e-9ffa-4579-96c4-5a4bb81c5b5f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:11.337621 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-31dfcd4e-9ffa-4579-96c4-5a4bb81c5b5f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:11.344371 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-31dfcd4e-9ffa-4579-96c4-5a4bb81c5b5f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:11.344813 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-31dfcd4e-9ffa-4579-96c4-5a4bb81c5b5f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:11.345572 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-31dfcd4e-9ffa-4579-96c4-5a4bb81c5b5f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:11.346000 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-31dfcd4e-9ffa-4579-96c4-5a4bb81c5b5f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:11.436334 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-31dfcd4e-9ffa-4579-96c4-5a4bb81c5b5f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.103491 Dec 20 09:38:11.437194 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 623/1286] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:11 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:12.448763 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d21d267f-136e-43ef-8a9f-65c604b7c96e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:12.449806 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d21d267f-136e-43ef-8a9f-65c604b7c96e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:12.456666 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d21d267f-136e-43ef-8a9f-65c604b7c96e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:12.457108 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d21d267f-136e-43ef-8a9f-65c604b7c96e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:12.457872 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d21d267f-136e-43ef-8a9f-65c604b7c96e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:12.458332 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d21d267f-136e-43ef-8a9f-65c604b7c96e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:12.525843 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d21d267f-136e-43ef-8a9f-65c604b7c96e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.081573 Dec 20 09:38:12.526506 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 664/1287] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:12 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:13.537872 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-812475c6-27b1-40f8-9eed-7c9c7bb4d8ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:13.538882 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-812475c6-27b1-40f8-9eed-7c9c7bb4d8ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:13.545789 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-812475c6-27b1-40f8-9eed-7c9c7bb4d8ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:13.546240 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-812475c6-27b1-40f8-9eed-7c9c7bb4d8ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:13.547020 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-812475c6-27b1-40f8-9eed-7c9c7bb4d8ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:13.547457 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-812475c6-27b1-40f8-9eed-7c9c7bb4d8ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:13.616228 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-812475c6-27b1-40f8-9eed-7c9c7bb4d8ff tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.082227 Dec 20 09:38:13.616855 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 624/1288] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:13 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:14.628818 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e8ce9e11-0918-4d88-ae38-76303ebdb062 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:14.629725 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e8ce9e11-0918-4d88-ae38-76303ebdb062 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:14.636534 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e8ce9e11-0918-4d88-ae38-76303ebdb062 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:14.636973 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e8ce9e11-0918-4d88-ae38-76303ebdb062 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:14.637736 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e8ce9e11-0918-4d88-ae38-76303ebdb062 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:14.638167 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e8ce9e11-0918-4d88-ae38-76303ebdb062 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:14.705997 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e8ce9e11-0918-4d88-ae38-76303ebdb062 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.081158 Dec 20 09:38:14.706663 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 665/1289] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:14 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:15.718274 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1d685f04-21f3-4969-be94-124591742d96 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:15.719201 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1d685f04-21f3-4969-be94-124591742d96 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:15.726117 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1d685f04-21f3-4969-be94-124591742d96 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:15.726568 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1d685f04-21f3-4969-be94-124591742d96 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:15.727343 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1d685f04-21f3-4969-be94-124591742d96 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:15.727813 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1d685f04-21f3-4969-be94-124591742d96 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:15.805845 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1d685f04-21f3-4969-be94-124591742d96 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.091691 Dec 20 09:38:15.806475 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 625/1290] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:15 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:16.822869 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-cd08f7d8-a694-4c99-9ff5-8884b1235bab tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:16.824050 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-cd08f7d8-a694-4c99-9ff5-8884b1235bab tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:16.831006 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cd08f7d8-a694-4c99-9ff5-8884b1235bab tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:16.831455 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cd08f7d8-a694-4c99-9ff5-8884b1235bab tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:16.832278 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cd08f7d8-a694-4c99-9ff5-8884b1235bab tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:16.832719 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cd08f7d8-a694-4c99-9ff5-8884b1235bab tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:16.901592 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-cd08f7d8-a694-4c99-9ff5-8884b1235bab tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.087636 Dec 20 09:38:16.902483 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 666/1291] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:16 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:16.991022 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-cd00fcfd-c807-4fd7-970d-584520189951 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-877171749"}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:16.991666 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-cd00fcfd-c807-4fd7-970d-584520189951 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:16.998583 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cd00fcfd-c807-4fd7-970d-584520189951 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:16.999033 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cd00fcfd-c807-4fd7-970d-584520189951 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:16.999844 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cd00fcfd-c807-4fd7-970d-584520189951 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:17.000284 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cd00fcfd-c807-4fd7-970d-584520189951 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:17.192731 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.network.security_group_api [None req-cd00fcfd-c807-4fd7-970d-584520189951 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Removing security group b5e8054d-b6dc-49e5-addb-dbb0c2005cae from port ca7f5f87-9783-4751-ad57-587b490d4b2d Dec 20 09:38:17.604882 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-cd00fcfd-c807-4fd7-970d-584520189951 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "POST /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8/action" status: 202 len: 0 microversion: 2.1 time: 0.618008 Dec 20 09:38:17.608312 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 626/1292] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:38:16 2021] POST /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8/action => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:17.623963 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-1183500c-da09-4c8c-888a-15a4b74ae445 req-ab209b69-1cb2-4762-8c00-61c9280993ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8", "tag": "ca7f5f87-9783-4751-ad57-587b490d4b2d"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:17.629660 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:38:17.629660 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:38:17.643541 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-1183500c-da09-4c8c-888a-15a4b74ae445 req-ab209b69-1cb2-4762-8c00-61c9280993ca service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:17.647419 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-1183500c-da09-4c8c-888a-15a4b74ae445 req-ab209b69-1cb2-4762-8c00-61c9280993ca service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:17.666156 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-1183500c-da09-4c8c-888a-15a4b74ae445 req-ab209b69-1cb2-4762-8c00-61c9280993ca service nova] Creating event network-changed:ca7f5f87-9783-4751-ad57-587b490d4b2d for instance 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 on hv-cinder-81908 Dec 20 09:38:17.684542 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-1183500c-da09-4c8c-888a-15a4b74ae445 req-ab209b69-1cb2-4762-8c00-61c9280993ca service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065088 Dec 20 09:38:17.696896 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 667/1293] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:38:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:38:17.913633 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-37702341-f778-4a3f-873c-b962d3c62fc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:17.917926 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-37702341-f778-4a3f-873c-b962d3c62fc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:17.921314 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-37702341-f778-4a3f-873c-b962d3c62fc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:17.922075 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-37702341-f778-4a3f-873c-b962d3c62fc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:17.923131 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-37702341-f778-4a3f-873c-b962d3c62fc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:17.923821 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-37702341-f778-4a3f-873c-b962d3c62fc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:18.043110 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-37702341-f778-4a3f-873c-b962d3c62fc9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.132453 Dec 20 09:38:18.043830 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 627/1294] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:17 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:19.054660 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-55d0db0f-0ea0-46ef-af2a-b40a4dfeab49 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:19.055728 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-55d0db0f-0ea0-46ef-af2a-b40a4dfeab49 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:19.063231 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-55d0db0f-0ea0-46ef-af2a-b40a4dfeab49 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:19.063787 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-55d0db0f-0ea0-46ef-af2a-b40a4dfeab49 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:19.064577 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-55d0db0f-0ea0-46ef-af2a-b40a4dfeab49 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:19.065002 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-55d0db0f-0ea0-46ef-af2a-b40a4dfeab49 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:19.128593 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-84824942-20c3-4e0f-a018-ffbd85f32ad5 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:19.129178 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-84824942-20c3-4e0f-a018-ffbd85f32ad5 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:19.129541 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-55d0db0f-0ea0-46ef-af2a-b40a4dfeab49 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.078397 Dec 20 09:38:19.130303 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 628/1295] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:19 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:38:19.135619 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84824942-20c3-4e0f-a018-ffbd85f32ad5 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:19.136597 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84824942-20c3-4e0f-a018-ffbd85f32ad5 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:19.137368 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84824942-20c3-4e0f-a018-ffbd85f32ad5 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:19.137795 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-84824942-20c3-4e0f-a018-ffbd85f32ad5 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:19.314439 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.objects.instance [None req-84824942-20c3-4e0f-a018-ffbd85f32ad5 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lazy-loading 'services' on Instance uuid 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 {{(pid=116674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:38:19.478317 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-84824942-20c3-4e0f-a018-ffbd85f32ad5 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8/os-volume_attachments/51e8cfa0-ad46-481b-8a6b-bed4f3ee0e2a" status: 202 len: 0 microversion: 2.1 time: 0.455513 Dec 20 09:38:19.478992 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 668/1296] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 20 09:38:19 2021] DELETE /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8/os-volume_attachments/51e8cfa0-ad46-481b-8a6b-bed4f3ee0e2a => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:19.487922 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0d135021-d66e-4ddc-afa4-96deed1c6894 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:19.489067 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0d135021-d66e-4ddc-afa4-96deed1c6894 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:19.508550 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0d135021-d66e-4ddc-afa4-96deed1c6894 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:19.508550 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0d135021-d66e-4ddc-afa4-96deed1c6894 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:19.508550 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0d135021-d66e-4ddc-afa4-96deed1c6894 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:19.508550 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0d135021-d66e-4ddc-afa4-96deed1c6894 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:19.529480 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0d135021-d66e-4ddc-afa4-96deed1c6894 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045753 Dec 20 09:38:19.537218 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 629/1297] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:38:19 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:38:19.711315 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-0cd88fd3-56ea-4aa7-b28c-db5ca034a2e7 req-8c3f03c9-0406-4cba-8c8c-4650a0f67b07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8", "tag": "ca7f5f87-9783-4751-ad57-587b490d4b2d"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:19.712958 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:38:19.712958 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:38:19.720222 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-0cd88fd3-56ea-4aa7-b28c-db5ca034a2e7 req-8c3f03c9-0406-4cba-8c8c-4650a0f67b07 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:19.720733 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-0cd88fd3-56ea-4aa7-b28c-db5ca034a2e7 req-8c3f03c9-0406-4cba-8c8c-4650a0f67b07 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:19.731877 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-0cd88fd3-56ea-4aa7-b28c-db5ca034a2e7 req-8c3f03c9-0406-4cba-8c8c-4650a0f67b07 service nova] Creating event network-changed:ca7f5f87-9783-4751-ad57-587b490d4b2d for instance 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 on hv-cinder-81908 Dec 20 09:38:19.736935 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-0cd88fd3-56ea-4aa7-b28c-db5ca034a2e7 req-8c3f03c9-0406-4cba-8c8c-4650a0f67b07 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030083 Dec 20 09:38:19.737536 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 669/1298] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:38:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:38:20.141561 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f0df87ad-06c3-42c8-9b35-ee8631916329 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:20.142519 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f0df87ad-06c3-42c8-9b35-ee8631916329 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:20.149164 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f0df87ad-06c3-42c8-9b35-ee8631916329 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:20.149623 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f0df87ad-06c3-42c8-9b35-ee8631916329 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:20.150599 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f0df87ad-06c3-42c8-9b35-ee8631916329 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:20.151032 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f0df87ad-06c3-42c8-9b35-ee8631916329 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:20.216954 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f0df87ad-06c3-42c8-9b35-ee8631916329 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.078883 Dec 20 09:38:20.217625 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 630/1299] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:20 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:20.542982 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-cb1d2e40-5392-4c0a-aa2a-518e7a017630 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:20.544016 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-cb1d2e40-5392-4c0a-aa2a-518e7a017630 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:20.550549 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cb1d2e40-5392-4c0a-aa2a-518e7a017630 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:20.550944 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cb1d2e40-5392-4c0a-aa2a-518e7a017630 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:20.551747 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cb1d2e40-5392-4c0a-aa2a-518e7a017630 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:20.552183 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cb1d2e40-5392-4c0a-aa2a-518e7a017630 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:20.580661 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-cb1d2e40-5392-4c0a-aa2a-518e7a017630 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042512 Dec 20 09:38:20.581228 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 670/1300] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:38:20 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:38:20.800883 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-90f3c0b9-2279-414c-9a79-76fdd4cb1933 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:20.801410 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-90f3c0b9-2279-414c-9a79-76fdd4cb1933 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:20.808356 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-90f3c0b9-2279-414c-9a79-76fdd4cb1933 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:20.808795 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-90f3c0b9-2279-414c-9a79-76fdd4cb1933 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:20.809558 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-90f3c0b9-2279-414c-9a79-76fdd4cb1933 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:20.809986 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-90f3c0b9-2279-414c-9a79-76fdd4cb1933 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:20.887442 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.objects.instance [None req-90f3c0b9-2279-414c-9a79-76fdd4cb1933 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lazy-loading 'services' on Instance uuid 1243c272-99f3-4606-9eb2-a4fe7cd30de7 {{(pid=116675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:38:21.072553 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-90f3c0b9-2279-414c-9a79-76fdd4cb1933 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/os-volume_attachments/b60c8923-fc70-418f-8129-697336e82de1" status: 202 len: 0 microversion: 2.1 time: 0.275585 Dec 20 09:38:21.073084 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 631/1301] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 20 09:38:20 2021] DELETE /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/os-volume_attachments/b60c8923-fc70-418f-8129-697336e82de1 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:21.328790 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-985ea69d-263e-4829-b0c3-12e595ccb09d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:21.329692 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-985ea69d-263e-4829-b0c3-12e595ccb09d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:21.335450 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-985ea69d-263e-4829-b0c3-12e595ccb09d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:21.335936 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-985ea69d-263e-4829-b0c3-12e595ccb09d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:21.336704 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-985ea69d-263e-4829-b0c3-12e595ccb09d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:21.337139 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-985ea69d-263e-4829-b0c3-12e595ccb09d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:21.437909 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-985ea69d-263e-4829-b0c3-12e595ccb09d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.208286 Dec 20 09:38:21.438536 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 671/1302] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:21 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:21.594680 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9d13cf56-5135-4f4d-8cb6-bc168ee9d523 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:21.595611 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9d13cf56-5135-4f4d-8cb6-bc168ee9d523 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:21.602579 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9d13cf56-5135-4f4d-8cb6-bc168ee9d523 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:21.603212 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9d13cf56-5135-4f4d-8cb6-bc168ee9d523 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:21.604237 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9d13cf56-5135-4f4d-8cb6-bc168ee9d523 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:21.604683 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9d13cf56-5135-4f4d-8cb6-bc168ee9d523 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:21.648278 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9d13cf56-5135-4f4d-8cb6-bc168ee9d523 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059343 Dec 20 09:38:21.654656 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 632/1303] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:38:21 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 09:38:21.663454 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c70d328b-484c-4dc3-93e4-668a096638e4 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:21.664098 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c70d328b-484c-4dc3-93e4-668a096638e4 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:21.671537 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c70d328b-484c-4dc3-93e4-668a096638e4 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:21.672031 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c70d328b-484c-4dc3-93e4-668a096638e4 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:21.672824 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c70d328b-484c-4dc3-93e4-668a096638e4 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:21.673264 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c70d328b-484c-4dc3-93e4-668a096638e4 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:21.746174 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.wsgi [None req-c70d328b-484c-4dc3-93e4-668a096638e4 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] HTTP exception thrown: Instance 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 is not attached to volume 51e8cfa0-ad46-481b-8a6b-bed4f3ee0e2a Dec 20 09:38:21.746822 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c70d328b-484c-4dc3-93e4-668a096638e4 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Returning 404 to user: Instance 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 is not attached to volume 51e8cfa0-ad46-481b-8a6b-bed4f3ee0e2a {{(pid=116674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:38:21.747677 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c70d328b-484c-4dc3-93e4-668a096638e4 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8/os-volume_attachments/51e8cfa0-ad46-481b-8a6b-bed4f3ee0e2a" status: 404 len: 154 microversion: 2.1 time: 0.088488 Dec 20 09:38:21.748241 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 672/1304] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 20 09:38:21 2021] DELETE /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8/os-volume_attachments/51e8cfa0-ad46-481b-8a6b-bed4f3ee0e2a => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 20 09:38:22.188183 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-32179bd9-3500-4117-970f-3d4834821cc7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:22.194537 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-32179bd9-3500-4117-970f-3d4834821cc7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:22.194996 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-32179bd9-3500-4117-970f-3d4834821cc7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:22.216533 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-32179bd9-3500-4117-970f-3d4834821cc7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Going to try to stop instance {{(pid=116675) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 20 09:38:22.413836 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-32179bd9-3500-4117-970f-3d4834821cc7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 202 len: 0 microversion: 2.1 time: 0.229159 Dec 20 09:38:22.414390 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 633/1305] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:38:22 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:22.422733 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-691a3d3e-d404-407d-b2ca-e9355e45ec61 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:22.423349 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-691a3d3e-d404-407d-b2ca-e9355e45ec61 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:22.430632 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-691a3d3e-d404-407d-b2ca-e9355e45ec61 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:22.431086 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-691a3d3e-d404-407d-b2ca-e9355e45ec61 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:22.431908 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-691a3d3e-d404-407d-b2ca-e9355e45ec61 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:22.432373 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-691a3d3e-d404-407d-b2ca-e9355e45ec61 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:22.449626 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-cec186e9-28b3-4534-a275-7e30c110cb92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:22.450665 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-cec186e9-28b3-4534-a275-7e30c110cb92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:22.456870 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cec186e9-28b3-4534-a275-7e30c110cb92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:22.457321 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cec186e9-28b3-4534-a275-7e30c110cb92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:22.458104 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cec186e9-28b3-4534-a275-7e30c110cb92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:22.458541 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cec186e9-28b3-4534-a275-7e30c110cb92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:22.521551 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-cec186e9-28b3-4534-a275-7e30c110cb92 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.075735 Dec 20 09:38:22.522225 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 634/1306] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:22 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:38:22.562836 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-691a3d3e-d404-407d-b2ca-e9355e45ec61 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:22.570155 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-691a3d3e-d404-407d-b2ca-e9355e45ec61 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1676 microversion: 2.1 time: 0.151031 Dec 20 09:38:22.570715 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 673/1307] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:38:22 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:38:22.993677 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-cbf78c05-5707-4cfb-b844-005a0d8c7b74 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:22.999110 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-cbf78c05-5707-4cfb-b844-005a0d8c7b74 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:23.001053 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cbf78c05-5707-4cfb-b844-005a0d8c7b74 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:23.001503 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cbf78c05-5707-4cfb-b844-005a0d8c7b74 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:23.002317 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cbf78c05-5707-4cfb-b844-005a0d8c7b74 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:23.002772 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cbf78c05-5707-4cfb-b844-005a0d8c7b74 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:23.027996 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-cbf78c05-5707-4cfb-b844-005a0d8c7b74 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Going to try to terminate instance {{(pid=116675) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 09:38:23.301951 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-cbf78c05-5707-4cfb-b844-005a0d8c7b74 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 204 len: 0 microversion: 2.1 time: 0.312127 Dec 20 09:38:23.302459 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 635/1308] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 20 09:38:22 2021] DELETE /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 09:38:23.310342 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-6de31a41-665a-48dc-b05e-73bd61ff140e tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:23.310976 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-6de31a41-665a-48dc-b05e-73bd61ff140e tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:23.317294 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6de31a41-665a-48dc-b05e-73bd61ff140e tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:23.318952 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6de31a41-665a-48dc-b05e-73bd61ff140e tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:23.318952 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6de31a41-665a-48dc-b05e-73bd61ff140e tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:23.318952 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6de31a41-665a-48dc-b05e-73bd61ff140e tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:23.450026 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-6de31a41-665a-48dc-b05e-73bd61ff140e tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:23.457318 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-6de31a41-665a-48dc-b05e-73bd61ff140e tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1552 microversion: 2.1 time: 0.150613 Dec 20 09:38:23.457897 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 674/1309] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:38:23 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:38:23.540476 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2c366ef8-e190-4841-a57a-b02e54b6fdce tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:23.541478 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2c366ef8-e190-4841-a57a-b02e54b6fdce tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:23.549069 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2c366ef8-e190-4841-a57a-b02e54b6fdce tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:23.549520 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2c366ef8-e190-4841-a57a-b02e54b6fdce tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:23.550289 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2c366ef8-e190-4841-a57a-b02e54b6fdce tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:23.550723 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2c366ef8-e190-4841-a57a-b02e54b6fdce tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:23.585982 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c46083dc-1321-40e6-b7ee-3072ae31706b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:23.586515 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c46083dc-1321-40e6-b7ee-3072ae31706b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:23.593074 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c46083dc-1321-40e6-b7ee-3072ae31706b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:23.593564 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c46083dc-1321-40e6-b7ee-3072ae31706b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:23.594359 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c46083dc-1321-40e6-b7ee-3072ae31706b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:23.594776 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c46083dc-1321-40e6-b7ee-3072ae31706b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:23.618418 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2c366ef8-e190-4841-a57a-b02e54b6fdce tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.081777 Dec 20 09:38:23.622280 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 636/1310] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:23 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:23.723508 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-c46083dc-1321-40e6-b7ee-3072ae31706b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:23.730781 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c46083dc-1321-40e6-b7ee-3072ae31706b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1676 microversion: 2.1 time: 0.148449 Dec 20 09:38:23.731353 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 675/1311] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:38:23 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:38:24.476914 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-db1d1dec-dbad-4ef7-94af-64033d165948 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:24.477613 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-db1d1dec-dbad-4ef7-94af-64033d165948 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:24.484899 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-db1d1dec-dbad-4ef7-94af-64033d165948 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:24.485349 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-db1d1dec-dbad-4ef7-94af-64033d165948 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:24.486115 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-db1d1dec-dbad-4ef7-94af-64033d165948 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:24.486550 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-db1d1dec-dbad-4ef7-94af-64033d165948 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:24.613825 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-db1d1dec-dbad-4ef7-94af-64033d165948 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:24.622294 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-db1d1dec-dbad-4ef7-94af-64033d165948 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1552 microversion: 2.1 time: 0.149395 Dec 20 09:38:24.622860 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 637/1312] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:38:24 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:38:24.629912 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-dd7c3563-57df-4edc-ba3d-3b032c0b62d6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:24.630906 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-dd7c3563-57df-4edc-ba3d-3b032c0b62d6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:24.637028 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dd7c3563-57df-4edc-ba3d-3b032c0b62d6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:24.637461 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dd7c3563-57df-4edc-ba3d-3b032c0b62d6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:24.638218 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dd7c3563-57df-4edc-ba3d-3b032c0b62d6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:24.638649 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dd7c3563-57df-4edc-ba3d-3b032c0b62d6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:24.703650 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-dd7c3563-57df-4edc-ba3d-3b032c0b62d6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.077340 Dec 20 09:38:24.704322 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 676/1313] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:24 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:24.748209 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6f116391-692b-481a-b181-39205aaffd4c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:24.748953 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6f116391-692b-481a-b181-39205aaffd4c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:24.755192 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6f116391-692b-481a-b181-39205aaffd4c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:24.755640 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6f116391-692b-481a-b181-39205aaffd4c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:24.756433 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6f116391-692b-481a-b181-39205aaffd4c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:24.756899 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6f116391-692b-481a-b181-39205aaffd4c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:24.886845 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6f116391-692b-481a-b181-39205aaffd4c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:24.894159 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6f116391-692b-481a-b181-39205aaffd4c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1676 microversion: 2.1 time: 0.150220 Dec 20 09:38:24.894719 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 638/1314] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:38:24 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:38:25.639270 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-dba6020c-93f0-40ad-b5c5-8fde49c4a1a1 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:25.639994 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-dba6020c-93f0-40ad-b5c5-8fde49c4a1a1 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:25.646973 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dba6020c-93f0-40ad-b5c5-8fde49c4a1a1 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:25.658257 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dba6020c-93f0-40ad-b5c5-8fde49c4a1a1 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:25.658257 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dba6020c-93f0-40ad-b5c5-8fde49c4a1a1 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:25.658257 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dba6020c-93f0-40ad-b5c5-8fde49c4a1a1 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:25.716111 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-aea349f7-56a5-4519-aa99-a75c7290827a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:25.717002 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-aea349f7-56a5-4519-aa99-a75c7290827a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:25.723546 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-aea349f7-56a5-4519-aa99-a75c7290827a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:25.724017 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-aea349f7-56a5-4519-aa99-a75c7290827a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:25.724801 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-aea349f7-56a5-4519-aa99-a75c7290827a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:25.725230 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-aea349f7-56a5-4519-aa99-a75c7290827a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:25.791917 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-dba6020c-93f0-40ad-b5c5-8fde49c4a1a1 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:25.795186 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-aea349f7-56a5-4519-aa99-a75c7290827a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.082070 Dec 20 09:38:25.796526 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 639/1315] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:25 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:38:25.799312 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-dba6020c-93f0-40ad-b5c5-8fde49c4a1a1 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1552 microversion: 2.1 time: 0.164606 Dec 20 09:38:25.799901 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 677/1316] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:38:25 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:38:25.912858 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a5611826-fb29-4039-b70b-bf684b359ecd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:25.913568 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a5611826-fb29-4039-b70b-bf684b359ecd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:25.921304 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a5611826-fb29-4039-b70b-bf684b359ecd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:25.921758 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a5611826-fb29-4039-b70b-bf684b359ecd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:25.922545 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a5611826-fb29-4039-b70b-bf684b359ecd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:25.922988 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a5611826-fb29-4039-b70b-bf684b359ecd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:26.070894 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a5611826-fb29-4039-b70b-bf684b359ecd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:26.075605 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a5611826-fb29-4039-b70b-bf684b359ecd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1676 microversion: 2.1 time: 0.166815 Dec 20 09:38:26.076405 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 640/1317] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:38:25 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:38:26.142749 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-b32138c0-6997-4b19-9127-fec07a494380 req-407b8ef1-87e1-4d6c-8e27-53053933b3a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8", "name": "network-vif-deleted", "tag": "ca7f5f87-9783-4751-ad57-587b490d4b2d"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:26.144282 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:38:26.144282 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:38:26.151377 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-b32138c0-6997-4b19-9127-fec07a494380 req-407b8ef1-87e1-4d6c-8e27-53053933b3a6 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:26.151859 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-b32138c0-6997-4b19-9127-fec07a494380 req-407b8ef1-87e1-4d6c-8e27-53053933b3a6 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:26.162376 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-b32138c0-6997-4b19-9127-fec07a494380 req-407b8ef1-87e1-4d6c-8e27-53053933b3a6 service nova] Creating event network-vif-deleted:ca7f5f87-9783-4751-ad57-587b490d4b2d for instance 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 on hv-cinder-81908 Dec 20 09:38:26.168086 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-b32138c0-6997-4b19-9127-fec07a494380 req-407b8ef1-87e1-4d6c-8e27-53053933b3a6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028858 Dec 20 09:38:26.169097 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 678/1318] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:38:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:38:26.806566 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-85fb1169-1246-42fa-b422-e942d0d597d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:26.807500 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-85fb1169-1246-42fa-b422-e942d0d597d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:26.814934 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-85fb1169-1246-42fa-b422-e942d0d597d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:26.815392 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-85fb1169-1246-42fa-b422-e942d0d597d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:26.816209 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-85fb1169-1246-42fa-b422-e942d0d597d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:26.816649 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-85fb1169-1246-42fa-b422-e942d0d597d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:26.817573 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a7228db0-a6fd-4a38-8272-f6c9cde68f9a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:26.818272 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a7228db0-a6fd-4a38-8272-f6c9cde68f9a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:26.825755 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a7228db0-a6fd-4a38-8272-f6c9cde68f9a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:26.826500 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a7228db0-a6fd-4a38-8272-f6c9cde68f9a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:26.827286 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a7228db0-a6fd-4a38-8272-f6c9cde68f9a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:26.827745 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a7228db0-a6fd-4a38-8272-f6c9cde68f9a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:26.859769 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a7228db0-a6fd-4a38-8272-f6c9cde68f9a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:26.860216 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a7228db0-a6fd-4a38-8272-f6c9cde68f9a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:26.860662 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.objects.instance [None req-a7228db0-a6fd-4a38-8272-f6c9cde68f9a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lazy-loading 'fault' on Instance uuid 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 {{(pid=116674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:38:26.877262 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-85fb1169-1246-42fa-b422-e942d0d597d9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.074192 Dec 20 09:38:26.878326 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 641/1319] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:26 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:26.900727 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a7228db0-a6fd-4a38-8272-f6c9cde68f9a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c528f1e5c49f69104826c0e4dafee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2d8e2c4a484ab78e35371e7ce0409e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:26.908577 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a7228db0-a6fd-4a38-8272-f6c9cde68f9a tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 200 len: 1346 microversion: 2.1 time: 0.095575 Dec 20 09:38:26.909151 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 679/1320] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:38:26 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 1346 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:38:27.093471 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-059ee064-ec66-4aac-aced-7ab2194b2947 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:27.094091 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-059ee064-ec66-4aac-aced-7ab2194b2947 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:27.100975 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-059ee064-ec66-4aac-aced-7ab2194b2947 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:27.101424 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-059ee064-ec66-4aac-aced-7ab2194b2947 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:27.102200 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-059ee064-ec66-4aac-aced-7ab2194b2947 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:27.102689 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-059ee064-ec66-4aac-aced-7ab2194b2947 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:27.230490 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-059ee064-ec66-4aac-aced-7ab2194b2947 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:27.243803 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-059ee064-ec66-4aac-aced-7ab2194b2947 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1676 microversion: 2.1 time: 0.154904 Dec 20 09:38:27.244386 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 642/1321] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:38:27 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:38:27.888936 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c0f92dc1-4eda-47c7-b2e7-11c8fef0fd22 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:27.889852 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c0f92dc1-4eda-47c7-b2e7-11c8fef0fd22 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:27.896139 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c0f92dc1-4eda-47c7-b2e7-11c8fef0fd22 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:27.896592 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c0f92dc1-4eda-47c7-b2e7-11c8fef0fd22 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:27.897367 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c0f92dc1-4eda-47c7-b2e7-11c8fef0fd22 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:27.897803 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c0f92dc1-4eda-47c7-b2e7-11c8fef0fd22 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:27.925624 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0e2e97a1-7a7f-421f-905e-001ab2268095 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:27.926225 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0e2e97a1-7a7f-421f-905e-001ab2268095 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] [instance: 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:27.932484 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0e2e97a1-7a7f-421f-905e-001ab2268095 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:27.932926 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0e2e97a1-7a7f-421f-905e-001ab2268095 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:27.933695 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0e2e97a1-7a7f-421f-905e-001ab2268095 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:27.934129 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0e2e97a1-7a7f-421f-905e-001ab2268095 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:27.946998 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-0e2e97a1-7a7f-421f-905e-001ab2268095 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] HTTP exception thrown: Instance 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 could not be found. Dec 20 09:38:27.947577 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0e2e97a1-7a7f-421f-905e-001ab2268095 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Returning 404 to user: Instance 7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 could not be found. {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:38:27.948414 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0e2e97a1-7a7f-421f-905e-001ab2268095 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8" status: 404 len: 111 microversion: 2.1 time: 0.026463 Dec 20 09:38:27.948927 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 643/1322] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:38:27 2021] GET /compute/v2.1/servers/7f0ea0fa-e048-4ab0-ab1e-bfd7c84fbac8 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 20 09:38:27.956327 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-04e4cbbb-7605-405b-b85a-1fd99996fd04 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] Calling method '.version_select at 0x7f914f4930d0>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:27.971085 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c0f92dc1-4eda-47c7-b2e7-11c8fef0fd22 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.085727 Dec 20 09:38:27.971765 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 680/1323] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:27 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:28.063089 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-04e4cbbb-7605-405b-b85a-1fd99996fd04 tempest-TestMinimumBasicScenario-1791285052 tempest-TestMinimumBasicScenario-1791285052-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-14800941" status: 202 len: 0 microversion: 2.1 time: 0.109851 Dec 20 09:38:28.063672 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 644/1324] 10.222.0.62 () {58 vars in 1265 bytes} [Mon Dec 20 09:38:27 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-14800941 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:38:28.261547 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-55251ba3-8180-42ab-ba1d-486f12a180c0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:28.262247 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-55251ba3-8180-42ab-ba1d-486f12a180c0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:28.269130 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-55251ba3-8180-42ab-ba1d-486f12a180c0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:28.269588 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-55251ba3-8180-42ab-ba1d-486f12a180c0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:28.270403 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-55251ba3-8180-42ab-ba1d-486f12a180c0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:28.270844 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-55251ba3-8180-42ab-ba1d-486f12a180c0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:28.418877 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-55251ba3-8180-42ab-ba1d-486f12a180c0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:28.426172 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-55251ba3-8180-42ab-ba1d-486f12a180c0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1676 microversion: 2.1 time: 0.169225 Dec 20 09:38:28.427644 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 681/1325] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:38:28 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:38:28.983155 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8a176798-c5c5-4ae7-946b-4d733380bde4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:28.984086 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8a176798-c5c5-4ae7-946b-4d733380bde4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:28.990761 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8a176798-c5c5-4ae7-946b-4d733380bde4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:28.991207 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8a176798-c5c5-4ae7-946b-4d733380bde4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:28.992001 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8a176798-c5c5-4ae7-946b-4d733380bde4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:28.992435 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8a176798-c5c5-4ae7-946b-4d733380bde4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:29.051989 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8a176798-c5c5-4ae7-946b-4d733380bde4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.073101 Dec 20 09:38:29.052857 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 645/1326] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:28 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:29.539889 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-df2ec94e-521e-4e99-b459-1f0376d8d58a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:29.540514 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-df2ec94e-521e-4e99-b459-1f0376d8d58a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:29.546882 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-df2ec94e-521e-4e99-b459-1f0376d8d58a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:29.547326 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-df2ec94e-521e-4e99-b459-1f0376d8d58a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:29.548123 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-df2ec94e-521e-4e99-b459-1f0376d8d58a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:29.548550 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-df2ec94e-521e-4e99-b459-1f0376d8d58a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:29.782417 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-df2ec94e-521e-4e99-b459-1f0376d8d58a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:29.789866 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-df2ec94e-521e-4e99-b459-1f0376d8d58a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1676 microversion: 2.1 time: 0.351421 Dec 20 09:38:29.790376 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 682/1327] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:38:29 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1676 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:38:30.063947 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e0f56be4-0bf0-4e99-801d-6927d28cc8db tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:30.064879 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e0f56be4-0bf0-4e99-801d-6927d28cc8db tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:30.071445 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e0f56be4-0bf0-4e99-801d-6927d28cc8db tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:30.071925 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e0f56be4-0bf0-4e99-801d-6927d28cc8db tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:30.073308 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e0f56be4-0bf0-4e99-801d-6927d28cc8db tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:30.073763 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e0f56be4-0bf0-4e99-801d-6927d28cc8db tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:30.134843 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e0f56be4-0bf0-4e99-801d-6927d28cc8db tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.074827 Dec 20 09:38:30.139212 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 646/1328] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:30 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:30.806432 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a049d529-118a-4c93-bdf9-cd78c26cb66e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:30.806969 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a049d529-118a-4c93-bdf9-cd78c26cb66e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:30.813157 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a049d529-118a-4c93-bdf9-cd78c26cb66e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:30.813603 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a049d529-118a-4c93-bdf9-cd78c26cb66e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:30.814386 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a049d529-118a-4c93-bdf9-cd78c26cb66e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:30.814823 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a049d529-118a-4c93-bdf9-cd78c26cb66e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:31.030717 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a049d529-118a-4c93-bdf9-cd78c26cb66e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:31.038320 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a049d529-118a-4c93-bdf9-cd78c26cb66e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1676 microversion: 2.1 time: 0.235575 Dec 20 09:38:31.038900 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 683/1329] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:38:30 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1676 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:38:31.147187 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-59a79cb3-d7f9-4bd7-80fa-2f4543fe84f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:31.148425 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-59a79cb3-d7f9-4bd7-80fa-2f4543fe84f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:31.163491 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-59a79cb3-d7f9-4bd7-80fa-2f4543fe84f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:31.166284 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-59a79cb3-d7f9-4bd7-80fa-2f4543fe84f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:31.168656 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-59a79cb3-d7f9-4bd7-80fa-2f4543fe84f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:31.169323 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-59a79cb3-d7f9-4bd7-80fa-2f4543fe84f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:31.244271 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-59a79cb3-d7f9-4bd7-80fa-2f4543fe84f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.101113 Dec 20 09:38:31.249620 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 647/1330] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:31 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:32.055968 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4e7ea1d3-8041-42cd-ba4e-4c62a2ef0aff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:32.056579 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-4e7ea1d3-8041-42cd-ba4e-4c62a2ef0aff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:32.063452 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4e7ea1d3-8041-42cd-ba4e-4c62a2ef0aff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:32.063931 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4e7ea1d3-8041-42cd-ba4e-4c62a2ef0aff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:32.064726 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4e7ea1d3-8041-42cd-ba4e-4c62a2ef0aff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:32.065161 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4e7ea1d3-8041-42cd-ba4e-4c62a2ef0aff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:32.260188 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-4e7ea1d3-8041-42cd-ba4e-4c62a2ef0aff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:32.263284 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-768a1c03-dd9a-497d-8b0f-210123e6edf9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:32.266916 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-768a1c03-dd9a-497d-8b0f-210123e6edf9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:32.274366 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-4e7ea1d3-8041-42cd-ba4e-4c62a2ef0aff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1676 microversion: 2.1 time: 0.221870 Dec 20 09:38:32.281277 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-768a1c03-dd9a-497d-8b0f-210123e6edf9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:32.281277 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-768a1c03-dd9a-497d-8b0f-210123e6edf9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:32.281277 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-768a1c03-dd9a-497d-8b0f-210123e6edf9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:32.282535 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 684/1331] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:38:32 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1676 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:38:32.291203 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-768a1c03-dd9a-497d-8b0f-210123e6edf9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:32.355980 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-768a1c03-dd9a-497d-8b0f-210123e6edf9 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.098681 Dec 20 09:38:32.356666 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 648/1332] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:32 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:38:33.298397 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9c4998ce-da19-4dae-a316-a459025d571f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:33.299010 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9c4998ce-da19-4dae-a316-a459025d571f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:33.305614 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9c4998ce-da19-4dae-a316-a459025d571f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:33.306070 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9c4998ce-da19-4dae-a316-a459025d571f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:33.306868 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9c4998ce-da19-4dae-a316-a459025d571f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:33.307855 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9c4998ce-da19-4dae-a316-a459025d571f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:33.368694 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-fd9041de-0d39-45f9-a671-725b7cc2c68e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:33.370207 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-fd9041de-0d39-45f9-a671-725b7cc2c68e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:33.377207 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fd9041de-0d39-45f9-a671-725b7cc2c68e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:33.377658 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fd9041de-0d39-45f9-a671-725b7cc2c68e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:33.378438 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fd9041de-0d39-45f9-a671-725b7cc2c68e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:33.378880 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fd9041de-0d39-45f9-a671-725b7cc2c68e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:33.441213 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-9c4998ce-da19-4dae-a316-a459025d571f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:33.448493 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9c4998ce-da19-4dae-a316-a459025d571f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1676 microversion: 2.1 time: 0.153980 Dec 20 09:38:33.449063 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 685/1333] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:38:33 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:38:33.464515 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-fd9041de-0d39-45f9-a671-725b7cc2c68e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.100229 Dec 20 09:38:33.468339 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 649/1334] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:33 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:38:34.465524 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b1656d6a-d11e-4c50-9273-fc607c3449ea tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:34.466277 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b1656d6a-d11e-4c50-9273-fc607c3449ea tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:34.476140 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c8b57e7b-5d06-48ae-b2a2-5bca9266557a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:34.477956 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c8b57e7b-5d06-48ae-b2a2-5bca9266557a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:34.486117 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b1656d6a-d11e-4c50-9273-fc607c3449ea tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:34.486565 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b1656d6a-d11e-4c50-9273-fc607c3449ea tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:34.487402 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b1656d6a-d11e-4c50-9273-fc607c3449ea tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:34.487862 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b1656d6a-d11e-4c50-9273-fc607c3449ea tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:34.502090 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c8b57e7b-5d06-48ae-b2a2-5bca9266557a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:34.502860 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c8b57e7b-5d06-48ae-b2a2-5bca9266557a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:34.503842 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c8b57e7b-5d06-48ae-b2a2-5bca9266557a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:34.504437 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c8b57e7b-5d06-48ae-b2a2-5bca9266557a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:34.574209 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c8b57e7b-5d06-48ae-b2a2-5bca9266557a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.102160 Dec 20 09:38:34.578307 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 650/1335] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:34 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:34.646965 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b1656d6a-d11e-4c50-9273-fc607c3449ea tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:34.658604 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b1656d6a-d11e-4c50-9273-fc607c3449ea tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1676 microversion: 2.1 time: 0.197032 Dec 20 09:38:34.659374 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 686/1336] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:38:34 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1676 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:38:35.586164 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-5173e0ec-2003-4703-9b9d-ce555406b804 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:35.587156 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-5173e0ec-2003-4703-9b9d-ce555406b804 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:35.594565 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5173e0ec-2003-4703-9b9d-ce555406b804 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:35.594984 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5173e0ec-2003-4703-9b9d-ce555406b804 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:35.595845 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5173e0ec-2003-4703-9b9d-ce555406b804 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:35.596276 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5173e0ec-2003-4703-9b9d-ce555406b804 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:35.658831 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-5173e0ec-2003-4703-9b9d-ce555406b804 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.076548 Dec 20 09:38:35.662678 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 651/1337] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:35 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:35.678093 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7f2fa6bc-145e-4e2f-ad99-eab631779d5e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:35.678798 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7f2fa6bc-145e-4e2f-ad99-eab631779d5e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:35.685371 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7f2fa6bc-145e-4e2f-ad99-eab631779d5e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:35.685920 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7f2fa6bc-145e-4e2f-ad99-eab631779d5e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:35.686739 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7f2fa6bc-145e-4e2f-ad99-eab631779d5e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:35.687242 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7f2fa6bc-145e-4e2f-ad99-eab631779d5e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:35.822017 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7f2fa6bc-145e-4e2f-ad99-eab631779d5e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:35.829521 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7f2fa6bc-145e-4e2f-ad99-eab631779d5e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1676 microversion: 2.1 time: 0.155124 Dec 20 09:38:35.830126 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 687/1338] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:38:35 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:38:36.670153 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-213ddfec-e43c-4e93-86c8-e32cef3c08e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:36.671877 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-213ddfec-e43c-4e93-86c8-e32cef3c08e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:36.678930 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-213ddfec-e43c-4e93-86c8-e32cef3c08e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:36.679427 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-213ddfec-e43c-4e93-86c8-e32cef3c08e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:36.680300 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-213ddfec-e43c-4e93-86c8-e32cef3c08e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:36.680742 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-213ddfec-e43c-4e93-86c8-e32cef3c08e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:36.754253 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-213ddfec-e43c-4e93-86c8-e32cef3c08e3 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.088162 Dec 20 09:38:36.755028 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 652/1339] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:36 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:36.846098 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4014082a-040e-40dc-97ac-827b0a2d7152 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:36.846649 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-4014082a-040e-40dc-97ac-827b0a2d7152 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:36.852951 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4014082a-040e-40dc-97ac-827b0a2d7152 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:36.853468 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4014082a-040e-40dc-97ac-827b0a2d7152 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:36.854221 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4014082a-040e-40dc-97ac-827b0a2d7152 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:36.855302 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4014082a-040e-40dc-97ac-827b0a2d7152 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:37.005405 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-4014082a-040e-40dc-97ac-827b0a2d7152 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:37.012821 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-4014082a-040e-40dc-97ac-827b0a2d7152 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1676 microversion: 2.1 time: 0.170466 Dec 20 09:38:37.013495 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 688/1340] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:38:36 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:38:37.766800 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-27a6b48b-8963-4832-9fd5-4434c01d7711 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:37.768029 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-27a6b48b-8963-4832-9fd5-4434c01d7711 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:37.775000 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-27a6b48b-8963-4832-9fd5-4434c01d7711 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:37.775527 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-27a6b48b-8963-4832-9fd5-4434c01d7711 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:37.782672 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-27a6b48b-8963-4832-9fd5-4434c01d7711 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:37.782672 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-27a6b48b-8963-4832-9fd5-4434c01d7711 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:37.840023 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-27a6b48b-8963-4832-9fd5-4434c01d7711 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.077082 Dec 20 09:38:37.840705 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 653/1341] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:37 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:38.028763 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-956116be-a61e-4785-9875-ad09d32adba1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:38.029666 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-956116be-a61e-4785-9875-ad09d32adba1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:38.035954 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-956116be-a61e-4785-9875-ad09d32adba1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:38.036469 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-956116be-a61e-4785-9875-ad09d32adba1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:38.037315 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-956116be-a61e-4785-9875-ad09d32adba1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:38.037811 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-956116be-a61e-4785-9875-ad09d32adba1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:38.169926 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-956116be-a61e-4785-9875-ad09d32adba1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:38.177535 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-956116be-a61e-4785-9875-ad09d32adba1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1653 microversion: 2.1 time: 0.152385 Dec 20 09:38:38.178193 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 689/1342] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:38:38 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1653 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:38:38.194879 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ba6e0b24-479a-451c-9a30-9df0c2e20916 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:38.201869 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ba6e0b24-479a-451c-9a30-9df0c2e20916 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:38.202322 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ba6e0b24-479a-451c-9a30-9df0c2e20916 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:38.226522 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ba6e0b24-479a-451c-9a30-9df0c2e20916 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Going to try to start instance {{(pid=116675) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 20 09:38:38.391252 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ba6e0b24-479a-451c-9a30-9df0c2e20916 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action" status: 202 len: 0 microversion: 2.1 time: 0.200568 Dec 20 09:38:38.391892 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 654/1343] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:38:38 2021] POST /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:38:38.399767 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-80618252-0308-4303-80ef-7ceb70578345 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:38.400384 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-80618252-0308-4303-80ef-7ceb70578345 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:38.407535 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-80618252-0308-4303-80ef-7ceb70578345 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:38.408224 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-80618252-0308-4303-80ef-7ceb70578345 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:38.409204 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-80618252-0308-4303-80ef-7ceb70578345 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:38.410423 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-80618252-0308-4303-80ef-7ceb70578345 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:38.557764 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-80618252-0308-4303-80ef-7ceb70578345 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:38.566391 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-80618252-0308-4303-80ef-7ceb70578345 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1662 microversion: 2.1 time: 0.170120 Dec 20 09:38:38.567156 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 690/1344] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:38:38 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1662 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:38:38.852740 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1609cec5-563e-4d1f-a1ad-1d21d3bfcbc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:38.853728 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1609cec5-563e-4d1f-a1ad-1d21d3bfcbc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:38.860250 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1609cec5-563e-4d1f-a1ad-1d21d3bfcbc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:38.860694 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1609cec5-563e-4d1f-a1ad-1d21d3bfcbc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:38.861473 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1609cec5-563e-4d1f-a1ad-1d21d3bfcbc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:38.861907 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1609cec5-563e-4d1f-a1ad-1d21d3bfcbc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:38.925694 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1609cec5-563e-4d1f-a1ad-1d21d3bfcbc6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.077283 Dec 20 09:38:38.929642 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 655/1345] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:38 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:39.584184 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1eef2d86-6eb3-4d3e-99fd-b8b2f8a0b8d3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:39.585128 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-1eef2d86-6eb3-4d3e-99fd-b8b2f8a0b8d3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:39.592404 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1eef2d86-6eb3-4d3e-99fd-b8b2f8a0b8d3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:39.593580 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1eef2d86-6eb3-4d3e-99fd-b8b2f8a0b8d3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:39.593580 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1eef2d86-6eb3-4d3e-99fd-b8b2f8a0b8d3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:39.594362 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1eef2d86-6eb3-4d3e-99fd-b8b2f8a0b8d3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:39.724219 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1eef2d86-6eb3-4d3e-99fd-b8b2f8a0b8d3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:39.731622 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1eef2d86-6eb3-4d3e-99fd-b8b2f8a0b8d3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1662 microversion: 2.1 time: 0.151088 Dec 20 09:38:39.733891 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 691/1346] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:38:39 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1662 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:38:39.937990 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6702afa1-3bb4-4591-9a1d-93b568d77350 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:39.938905 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6702afa1-3bb4-4591-9a1d-93b568d77350 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:39.945840 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6702afa1-3bb4-4591-9a1d-93b568d77350 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:39.946293 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6702afa1-3bb4-4591-9a1d-93b568d77350 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:39.947063 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6702afa1-3bb4-4591-9a1d-93b568d77350 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:39.947530 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6702afa1-3bb4-4591-9a1d-93b568d77350 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:40.008107 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6702afa1-3bb4-4591-9a1d-93b568d77350 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.074124 Dec 20 09:38:40.008734 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 656/1347] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:39 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:40.748987 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0f28dfba-1dd0-494c-a73e-704914368337 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:40.749578 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0f28dfba-1dd0-494c-a73e-704914368337 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:40.755871 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0f28dfba-1dd0-494c-a73e-704914368337 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:40.759700 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0f28dfba-1dd0-494c-a73e-704914368337 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:40.759700 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0f28dfba-1dd0-494c-a73e-704914368337 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:40.759700 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0f28dfba-1dd0-494c-a73e-704914368337 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:40.888182 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-0f28dfba-1dd0-494c-a73e-704914368337 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:40.895323 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0f28dfba-1dd0-494c-a73e-704914368337 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1666 microversion: 2.1 time: 0.150061 Dec 20 09:38:40.895909 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 692/1348] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:38:40 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1666 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:38:41.020162 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-85d9e18c-03b4-4041-9378-9e00b4e1f7ee tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:41.021090 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-85d9e18c-03b4-4041-9378-9e00b4e1f7ee tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:41.028513 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-85d9e18c-03b4-4041-9378-9e00b4e1f7ee tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:41.028965 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-85d9e18c-03b4-4041-9378-9e00b4e1f7ee tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:41.029735 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-85d9e18c-03b4-4041-9378-9e00b4e1f7ee tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:41.030177 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-85d9e18c-03b4-4041-9378-9e00b4e1f7ee tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:41.088325 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-85d9e18c-03b4-4041-9378-9e00b4e1f7ee tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 28635 microversion: 2.20 time: 0.072164 Dec 20 09:38:41.088938 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 657/1349] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:41 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 28635 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:38:42.100961 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9b8f413a-0c23-4413-96f6-ca66013f3a21 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:42.101936 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9b8f413a-0c23-4413-96f6-ca66013f3a21 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:42.108844 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9b8f413a-0c23-4413-96f6-ca66013f3a21 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:42.109295 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9b8f413a-0c23-4413-96f6-ca66013f3a21 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:42.110077 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9b8f413a-0c23-4413-96f6-ca66013f3a21 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:42.110522 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9b8f413a-0c23-4413-96f6-ca66013f3a21 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:42.195215 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9b8f413a-0c23-4413-96f6-ca66013f3a21 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 29202 microversion: 2.20 time: 0.097809 Dec 20 09:38:42.195893 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 693/1350] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:42 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 29202 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:43.207254 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a7d708a6-c290-4346-b4b0-08fb4de2e5be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:43.208353 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a7d708a6-c290-4346-b4b0-08fb4de2e5be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:43.216238 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a7d708a6-c290-4346-b4b0-08fb4de2e5be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:43.216692 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a7d708a6-c290-4346-b4b0-08fb4de2e5be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:43.217466 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a7d708a6-c290-4346-b4b0-08fb4de2e5be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:43.217903 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a7d708a6-c290-4346-b4b0-08fb4de2e5be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:43.307202 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a7d708a6-c290-4346-b4b0-08fb4de2e5be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 31193 microversion: 2.20 time: 0.103806 Dec 20 09:38:43.307978 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 658/1351] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:43 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 31193 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:44.324476 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-50e25320-408e-4d06-b4c2-4e8c484b950f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:44.326169 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-50e25320-408e-4d06-b4c2-4e8c484b950f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:44.333284 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-50e25320-408e-4d06-b4c2-4e8c484b950f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:44.333725 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-50e25320-408e-4d06-b4c2-4e8c484b950f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:44.334488 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-50e25320-408e-4d06-b4c2-4e8c484b950f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:44.334917 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-50e25320-408e-4d06-b4c2-4e8c484b950f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:44.410967 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-50e25320-408e-4d06-b4c2-4e8c484b950f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 32556 microversion: 2.20 time: 0.094117 Dec 20 09:38:44.411652 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 694/1352] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:44 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 32556 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:45.422821 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6777a5c5-4ac2-4539-ae73-94c049b270fa tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:45.423869 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6777a5c5-4ac2-4539-ae73-94c049b270fa tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:45.430702 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6777a5c5-4ac2-4539-ae73-94c049b270fa tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:45.431155 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6777a5c5-4ac2-4539-ae73-94c049b270fa tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:45.431966 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6777a5c5-4ac2-4539-ae73-94c049b270fa tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:45.432406 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6777a5c5-4ac2-4539-ae73-94c049b270fa tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:45.504621 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6777a5c5-4ac2-4539-ae73-94c049b270fa tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 33599 microversion: 2.20 time: 0.085743 Dec 20 09:38:45.505276 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 659/1353] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:45 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 33599 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:46.517537 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f8d4bb1f-a106-45c1-b761-f71752db8d01 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:46.518548 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f8d4bb1f-a106-45c1-b761-f71752db8d01 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:46.525488 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f8d4bb1f-a106-45c1-b761-f71752db8d01 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:46.525935 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f8d4bb1f-a106-45c1-b761-f71752db8d01 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:46.527228 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f8d4bb1f-a106-45c1-b761-f71752db8d01 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:46.527686 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f8d4bb1f-a106-45c1-b761-f71752db8d01 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:46.609945 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f8d4bb1f-a106-45c1-b761-f71752db8d01 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 35096 microversion: 2.20 time: 0.096910 Dec 20 09:38:46.610509 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 695/1354] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:46 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 35096 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:47.622228 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b33c2251-3774-4d26-b773-1363ef03b021 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:47.623221 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b33c2251-3774-4d26-b773-1363ef03b021 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:47.630106 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b33c2251-3774-4d26-b773-1363ef03b021 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:47.630546 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b33c2251-3774-4d26-b773-1363ef03b021 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:47.631308 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b33c2251-3774-4d26-b773-1363ef03b021 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:47.631761 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b33c2251-3774-4d26-b773-1363ef03b021 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:47.712581 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b33c2251-3774-4d26-b773-1363ef03b021 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 36655 microversion: 2.20 time: 0.094171 Dec 20 09:38:47.713152 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 660/1355] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:47 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 36655 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:38:48.725312 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5ae7c4eb-ef88-4581-af8c-1ea51c092b1b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:48.726330 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-5ae7c4eb-ef88-4581-af8c-1ea51c092b1b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:48.733191 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5ae7c4eb-ef88-4581-af8c-1ea51c092b1b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:48.733634 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5ae7c4eb-ef88-4581-af8c-1ea51c092b1b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:48.734397 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5ae7c4eb-ef88-4581-af8c-1ea51c092b1b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:48.734826 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5ae7c4eb-ef88-4581-af8c-1ea51c092b1b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:48.810640 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-5ae7c4eb-ef88-4581-af8c-1ea51c092b1b tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 38189 microversion: 2.20 time: 0.089272 Dec 20 09:38:48.811296 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 696/1356] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:48 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 38189 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:49.823149 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0fef7bc4-3e34-468b-9a39-e45bf3fa9f00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:49.824659 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0fef7bc4-3e34-468b-9a39-e45bf3fa9f00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:49.831497 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0fef7bc4-3e34-468b-9a39-e45bf3fa9f00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:49.831976 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0fef7bc4-3e34-468b-9a39-e45bf3fa9f00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:49.832752 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0fef7bc4-3e34-468b-9a39-e45bf3fa9f00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:49.833187 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0fef7bc4-3e34-468b-9a39-e45bf3fa9f00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:49.893468 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0fef7bc4-3e34-468b-9a39-e45bf3fa9f00 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 38189 microversion: 2.20 time: 0.074405 Dec 20 09:38:49.894080 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 661/1357] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:49 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 38189 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:38:50.906071 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c76db1c1-a731-4a91-9223-29132f73f578 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:50.907079 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c76db1c1-a731-4a91-9223-29132f73f578 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:50.914067 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c76db1c1-a731-4a91-9223-29132f73f578 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:50.914519 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c76db1c1-a731-4a91-9223-29132f73f578 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:50.915298 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c76db1c1-a731-4a91-9223-29132f73f578 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:50.915763 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c76db1c1-a731-4a91-9223-29132f73f578 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:50.982551 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c76db1c1-a731-4a91-9223-29132f73f578 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 38189 microversion: 2.20 time: 0.080521 Dec 20 09:38:50.983434 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 697/1358] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:50 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 38189 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:51.995375 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-5ed9d418-0c93-4b52-9bec-7fc7539da7df tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:51.996415 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-5ed9d418-0c93-4b52-9bec-7fc7539da7df tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:52.003274 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5ed9d418-0c93-4b52-9bec-7fc7539da7df tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:52.003788 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5ed9d418-0c93-4b52-9bec-7fc7539da7df tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:52.004560 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5ed9d418-0c93-4b52-9bec-7fc7539da7df tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:52.004998 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5ed9d418-0c93-4b52-9bec-7fc7539da7df tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:52.069038 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-5ed9d418-0c93-4b52-9bec-7fc7539da7df tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 38189 microversion: 2.20 time: 0.077547 Dec 20 09:38:52.069678 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 662/1359] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:51 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 38189 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:53.083373 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7becc412-db05-4b2d-8ab2-e35b548f5ec5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:53.084417 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7becc412-db05-4b2d-8ab2-e35b548f5ec5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:53.091304 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7becc412-db05-4b2d-8ab2-e35b548f5ec5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:53.091787 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7becc412-db05-4b2d-8ab2-e35b548f5ec5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:53.092564 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7becc412-db05-4b2d-8ab2-e35b548f5ec5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:53.093006 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7becc412-db05-4b2d-8ab2-e35b548f5ec5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:53.171290 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7becc412-db05-4b2d-8ab2-e35b548f5ec5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 38322 microversion: 2.20 time: 0.091806 Dec 20 09:38:53.172232 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 698/1360] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:53 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 38322 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:54.183765 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-eb176094-a292-466a-922e-8d94b0a9bd0c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:54.184768 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-eb176094-a292-466a-922e-8d94b0a9bd0c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:54.191610 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eb176094-a292-466a-922e-8d94b0a9bd0c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:54.192092 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eb176094-a292-466a-922e-8d94b0a9bd0c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:54.192870 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eb176094-a292-466a-922e-8d94b0a9bd0c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:54.193314 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eb176094-a292-466a-922e-8d94b0a9bd0c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:54.271499 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-eb176094-a292-466a-922e-8d94b0a9bd0c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 200 len: 38330 microversion: 2.20 time: 0.092166 Dec 20 09:38:54.272187 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 663/1361] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:54 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 38330 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:38:54.282494 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-619accad-b63c-4482-a09a-da359eaad4a6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:54.283103 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-619accad-b63c-4482-a09a-da359eaad4a6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:54.289981 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-619accad-b63c-4482-a09a-da359eaad4a6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:54.290419 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-619accad-b63c-4482-a09a-da359eaad4a6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:54.291216 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-619accad-b63c-4482-a09a-da359eaad4a6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:54.291647 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-619accad-b63c-4482-a09a-da359eaad4a6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:54.314528 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-619accad-b63c-4482-a09a-da359eaad4a6 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/ips" status: 200 len: 152 microversion: 2.20 time: 0.036025 Dec 20 09:38:54.315314 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 699/1362] 10.222.0.62 () {60 vars in 1288 bytes} [Mon Dec 20 09:38:54 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:38:56.678345 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-151727e7-453c-4fb4-b093-85faef8e2ca0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:38:56.678974 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-151727e7-453c-4fb4-b093-85faef8e2ca0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:56.686424 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-151727e7-453c-4fb4-b093-85faef8e2ca0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:56.686873 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-151727e7-453c-4fb4-b093-85faef8e2ca0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:56.687644 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-151727e7-453c-4fb4-b093-85faef8e2ca0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:56.688099 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-151727e7-453c-4fb4-b093-85faef8e2ca0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:56.710203 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.objects.instance [None req-151727e7-453c-4fb4-b093-85faef8e2ca0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lazy-loading 'flavor' on Instance uuid 9faf5b6c-7f96-4a91-b944-fd72f5665f64 {{(pid=116675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:38:57.183208 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-151727e7-453c-4fb4-b093-85faef8e2ca0 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 202 len: 0 microversion: 2.20 time: 0.508817 Dec 20 09:38:57.184429 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 664/1363] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:38:56 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 20 09:38:57.192288 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-dcaff279-1e4f-420b-9cbb-bc6b42bcd5e2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:57.192966 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-dcaff279-1e4f-420b-9cbb-bc6b42bcd5e2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:57.200056 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dcaff279-1e4f-420b-9cbb-bc6b42bcd5e2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:57.200504 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dcaff279-1e4f-420b-9cbb-bc6b42bcd5e2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:57.201290 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dcaff279-1e4f-420b-9cbb-bc6b42bcd5e2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:57.201723 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-dcaff279-1e4f-420b-9cbb-bc6b42bcd5e2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:57.331538 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-dcaff279-1e4f-420b-9cbb-bc6b42bcd5e2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:57.339324 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-dcaff279-1e4f-420b-9cbb-bc6b42bcd5e2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:57.340849 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-dcaff279-1e4f-420b-9cbb-bc6b42bcd5e2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:57.342014 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-dcaff279-1e4f-420b-9cbb-bc6b42bcd5e2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1724 microversion: 2.20 time: 0.153522 Dec 20 09:38:57.342576 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 700/1364] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:38:57 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:38:58.360763 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6694470c-3c43-411b-93d6-483c3c41a69e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:58.361470 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6694470c-3c43-411b-93d6-483c3c41a69e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:58.368037 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6694470c-3c43-411b-93d6-483c3c41a69e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:58.368486 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6694470c-3c43-411b-93d6-483c3c41a69e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:58.369254 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6694470c-3c43-411b-93d6-483c3c41a69e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:58.369692 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6694470c-3c43-411b-93d6-483c3c41a69e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:58.503338 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6694470c-3c43-411b-93d6-483c3c41a69e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:58.511018 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6694470c-3c43-411b-93d6-483c3c41a69e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:58.512540 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6694470c-3c43-411b-93d6-483c3c41a69e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:58.514337 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6694470c-3c43-411b-93d6-483c3c41a69e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1724 microversion: 2.20 time: 0.158153 Dec 20 09:38:58.514913 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 665/1365] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:38:58 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:38:59.531964 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d3b58a8c-8e95-4d9f-9f1c-d2a04ed18d21 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:38:59.532567 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d3b58a8c-8e95-4d9f-9f1c-d2a04ed18d21 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:38:59.538795 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d3b58a8c-8e95-4d9f-9f1c-d2a04ed18d21 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:59.539234 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d3b58a8c-8e95-4d9f-9f1c-d2a04ed18d21 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:59.540041 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d3b58a8c-8e95-4d9f-9f1c-d2a04ed18d21 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:38:59.540471 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d3b58a8c-8e95-4d9f-9f1c-d2a04ed18d21 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:38:59.669944 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d3b58a8c-8e95-4d9f-9f1c-d2a04ed18d21 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:59.677641 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d3b58a8c-8e95-4d9f-9f1c-d2a04ed18d21 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:59.679133 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d3b58a8c-8e95-4d9f-9f1c-d2a04ed18d21 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:38:59.680311 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d3b58a8c-8e95-4d9f-9f1c-d2a04ed18d21 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1724 microversion: 2.20 time: 0.152033 Dec 20 09:38:59.680874 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 701/1366] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:38:59 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:00.698115 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6895e1e3-f9b0-48a8-aec0-531ec8475419 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:00.698724 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6895e1e3-f9b0-48a8-aec0-531ec8475419 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:00.705005 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6895e1e3-f9b0-48a8-aec0-531ec8475419 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:00.705449 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6895e1e3-f9b0-48a8-aec0-531ec8475419 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:00.706221 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6895e1e3-f9b0-48a8-aec0-531ec8475419 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:00.706653 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6895e1e3-f9b0-48a8-aec0-531ec8475419 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:00.832154 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6895e1e3-f9b0-48a8-aec0-531ec8475419 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:00.840245 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6895e1e3-f9b0-48a8-aec0-531ec8475419 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:00.842161 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6895e1e3-f9b0-48a8-aec0-531ec8475419 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:00.843303 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6895e1e3-f9b0-48a8-aec0-531ec8475419 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1724 microversion: 2.20 time: 0.148914 Dec 20 09:39:00.843920 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 666/1367] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:00 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:01.861665 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-6c7b3eab-4d79-4ff9-93a0-c99155c2ff60 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:01.862307 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-6c7b3eab-4d79-4ff9-93a0-c99155c2ff60 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:01.868840 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6c7b3eab-4d79-4ff9-93a0-c99155c2ff60 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:01.869291 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6c7b3eab-4d79-4ff9-93a0-c99155c2ff60 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:01.870068 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6c7b3eab-4d79-4ff9-93a0-c99155c2ff60 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:01.870506 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6c7b3eab-4d79-4ff9-93a0-c99155c2ff60 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:02.002203 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-6c7b3eab-4d79-4ff9-93a0-c99155c2ff60 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:02.009902 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-6c7b3eab-4d79-4ff9-93a0-c99155c2ff60 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:02.011386 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-6c7b3eab-4d79-4ff9-93a0-c99155c2ff60 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:02.012553 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-6c7b3eab-4d79-4ff9-93a0-c99155c2ff60 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1724 microversion: 2.20 time: 0.154571 Dec 20 09:39:02.013112 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 702/1368] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:01 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:03.030760 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-389e429e-b9b3-47ee-ade7-90fed1ebfe97 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:03.031368 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-389e429e-b9b3-47ee-ade7-90fed1ebfe97 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:03.037792 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-389e429e-b9b3-47ee-ade7-90fed1ebfe97 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:03.038237 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-389e429e-b9b3-47ee-ade7-90fed1ebfe97 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:03.039006 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-389e429e-b9b3-47ee-ade7-90fed1ebfe97 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:03.039432 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-389e429e-b9b3-47ee-ade7-90fed1ebfe97 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:03.166555 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-389e429e-b9b3-47ee-ade7-90fed1ebfe97 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:03.174956 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-389e429e-b9b3-47ee-ade7-90fed1ebfe97 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:03.176484 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-389e429e-b9b3-47ee-ade7-90fed1ebfe97 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:03.177674 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-389e429e-b9b3-47ee-ade7-90fed1ebfe97 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1724 microversion: 2.20 time: 0.151121 Dec 20 09:39:03.178230 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 667/1369] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:03 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:04.195241 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d8072703-af81-4f71-a923-78a5811af35a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:04.195870 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d8072703-af81-4f71-a923-78a5811af35a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:04.202071 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d8072703-af81-4f71-a923-78a5811af35a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:04.202515 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d8072703-af81-4f71-a923-78a5811af35a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:04.203278 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d8072703-af81-4f71-a923-78a5811af35a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:04.203741 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d8072703-af81-4f71-a923-78a5811af35a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:04.334646 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d8072703-af81-4f71-a923-78a5811af35a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:04.342253 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d8072703-af81-4f71-a923-78a5811af35a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:04.343757 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d8072703-af81-4f71-a923-78a5811af35a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:04.344895 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d8072703-af81-4f71-a923-78a5811af35a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1724 microversion: 2.20 time: 0.153402 Dec 20 09:39:04.345447 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 703/1370] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:04 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:05.362967 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1e318939-5e23-445a-a602-0b73e9172597 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:05.363599 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1e318939-5e23-445a-a602-0b73e9172597 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:05.370033 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1e318939-5e23-445a-a602-0b73e9172597 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:05.370472 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1e318939-5e23-445a-a602-0b73e9172597 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:05.371253 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1e318939-5e23-445a-a602-0b73e9172597 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:05.371676 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1e318939-5e23-445a-a602-0b73e9172597 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:05.498882 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1e318939-5e23-445a-a602-0b73e9172597 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:05.506487 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1e318939-5e23-445a-a602-0b73e9172597 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:05.507980 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1e318939-5e23-445a-a602-0b73e9172597 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:05.509116 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1e318939-5e23-445a-a602-0b73e9172597 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1724 microversion: 2.20 time: 0.149858 Dec 20 09:39:05.509677 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 668/1371] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:05 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:06.527241 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-33e50e9e-de7b-4a98-aa10-509e506d81de tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:06.527870 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-33e50e9e-de7b-4a98-aa10-509e506d81de tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:06.534755 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-33e50e9e-de7b-4a98-aa10-509e506d81de tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:06.535281 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-33e50e9e-de7b-4a98-aa10-509e506d81de tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:06.536086 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-33e50e9e-de7b-4a98-aa10-509e506d81de tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:06.536515 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-33e50e9e-de7b-4a98-aa10-509e506d81de tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:06.668187 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-33e50e9e-de7b-4a98-aa10-509e506d81de tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:06.669974 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-33e50e9e-de7b-4a98-aa10-509e506d81de tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:06.671441 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-33e50e9e-de7b-4a98-aa10-509e506d81de tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:06.672642 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-33e50e9e-de7b-4a98-aa10-509e506d81de tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1724 microversion: 2.20 time: 0.149186 Dec 20 09:39:06.673195 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 704/1372] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:06 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:07.690282 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-011fd5aa-1d65-4773-9617-11432a362276 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:07.690796 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-011fd5aa-1d65-4773-9617-11432a362276 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:07.697163 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-011fd5aa-1d65-4773-9617-11432a362276 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:07.697649 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-011fd5aa-1d65-4773-9617-11432a362276 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:07.698422 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-011fd5aa-1d65-4773-9617-11432a362276 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:07.698857 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-011fd5aa-1d65-4773-9617-11432a362276 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:07.840044 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-011fd5aa-1d65-4773-9617-11432a362276 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:07.848204 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-011fd5aa-1d65-4773-9617-11432a362276 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:07.849672 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-011fd5aa-1d65-4773-9617-11432a362276 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:07.850818 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-011fd5aa-1d65-4773-9617-11432a362276 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1724 microversion: 2.20 time: 0.164376 Dec 20 09:39:07.851377 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 669/1373] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:07 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:08.867748 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0a77111d-d6a5-4022-a906-0a9d49848101 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:08.868364 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0a77111d-d6a5-4022-a906-0a9d49848101 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:08.875188 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0a77111d-d6a5-4022-a906-0a9d49848101 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:08.875639 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0a77111d-d6a5-4022-a906-0a9d49848101 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:08.876444 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0a77111d-d6a5-4022-a906-0a9d49848101 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:08.876883 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0a77111d-d6a5-4022-a906-0a9d49848101 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:09.003196 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-0a77111d-d6a5-4022-a906-0a9d49848101 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:09.010858 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-0a77111d-d6a5-4022-a906-0a9d49848101 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:09.012382 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-0a77111d-d6a5-4022-a906-0a9d49848101 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:09.013531 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0a77111d-d6a5-4022-a906-0a9d49848101 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1745 microversion: 2.20 time: 0.149781 Dec 20 09:39:09.014090 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 705/1374] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:08 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:10.031818 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-3bc58ffc-6ccf-4f55-b211-b48dee9dc015 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:10.032432 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-3bc58ffc-6ccf-4f55-b211-b48dee9dc015 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:10.038707 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3bc58ffc-6ccf-4f55-b211-b48dee9dc015 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:10.039156 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3bc58ffc-6ccf-4f55-b211-b48dee9dc015 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:10.039958 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3bc58ffc-6ccf-4f55-b211-b48dee9dc015 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:10.040397 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3bc58ffc-6ccf-4f55-b211-b48dee9dc015 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:10.169220 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-3bc58ffc-6ccf-4f55-b211-b48dee9dc015 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:10.177026 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-3bc58ffc-6ccf-4f55-b211-b48dee9dc015 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:10.178512 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-3bc58ffc-6ccf-4f55-b211-b48dee9dc015 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:10.179705 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-3bc58ffc-6ccf-4f55-b211-b48dee9dc015 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1745 microversion: 2.20 time: 0.152185 Dec 20 09:39:10.180238 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 670/1375] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:10 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:11.197756 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f3cd31a5-a234-4498-916c-79ca3e08a052 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:11.201154 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f3cd31a5-a234-4498-916c-79ca3e08a052 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:11.205503 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f3cd31a5-a234-4498-916c-79ca3e08a052 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:11.205953 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f3cd31a5-a234-4498-916c-79ca3e08a052 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:11.206738 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f3cd31a5-a234-4498-916c-79ca3e08a052 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:11.207176 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f3cd31a5-a234-4498-916c-79ca3e08a052 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:11.334754 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f3cd31a5-a234-4498-916c-79ca3e08a052 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:11.342749 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f3cd31a5-a234-4498-916c-79ca3e08a052 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:11.344383 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f3cd31a5-a234-4498-916c-79ca3e08a052 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:11.345532 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f3cd31a5-a234-4498-916c-79ca3e08a052 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1745 microversion: 2.20 time: 0.151525 Dec 20 09:39:11.346095 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 706/1376] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:11 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:12.364080 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ec08dd2d-d8a2-41cb-92e2-e6ee6676db84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:12.364693 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ec08dd2d-d8a2-41cb-92e2-e6ee6676db84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:12.370990 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ec08dd2d-d8a2-41cb-92e2-e6ee6676db84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:12.371432 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ec08dd2d-d8a2-41cb-92e2-e6ee6676db84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:12.372272 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ec08dd2d-d8a2-41cb-92e2-e6ee6676db84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:12.372734 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ec08dd2d-d8a2-41cb-92e2-e6ee6676db84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:12.505825 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ec08dd2d-d8a2-41cb-92e2-e6ee6676db84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:12.513433 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ec08dd2d-d8a2-41cb-92e2-e6ee6676db84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:12.514937 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ec08dd2d-d8a2-41cb-92e2-e6ee6676db84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:12.516124 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ec08dd2d-d8a2-41cb-92e2-e6ee6676db84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1745 microversion: 2.20 time: 0.156123 Dec 20 09:39:12.516684 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 671/1377] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:12 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:12.828606 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-79492039-0907-45a1-9f01-96da64a9eaf9 req-f818d0b3-628c-4d94-823c-5e6c32dba55f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9faf5b6c-7f96-4a91-b944-fd72f5665f64", "name": "network-vif-plugged", "status": "completed", "tag": "4fac1673-dd2f-4368-bfcc-be873f33a32b"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:39:12.833482 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:39:12.833482 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:39:12.837647 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-79492039-0907-45a1-9f01-96da64a9eaf9 req-f818d0b3-628c-4d94-823c-5e6c32dba55f service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:12.838088 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-79492039-0907-45a1-9f01-96da64a9eaf9 req-f818d0b3-628c-4d94-823c-5e6c32dba55f service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:12.848988 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-79492039-0907-45a1-9f01-96da64a9eaf9 req-f818d0b3-628c-4d94-823c-5e6c32dba55f service nova] Creating event network-vif-plugged:4fac1673-dd2f-4368-bfcc-be873f33a32b for instance 9faf5b6c-7f96-4a91-b944-fd72f5665f64 on hv-cinder-81908 Dec 20 09:39:12.853922 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-79492039-0907-45a1-9f01-96da64a9eaf9 req-f818d0b3-628c-4d94-823c-5e6c32dba55f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029796 Dec 20 09:39:12.854518 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 707/1378] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:39:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:39:13.534306 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6478598a-d901-454d-82b6-be0b0eb85d68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:13.534909 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6478598a-d901-454d-82b6-be0b0eb85d68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:13.541313 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6478598a-d901-454d-82b6-be0b0eb85d68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:13.541752 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6478598a-d901-454d-82b6-be0b0eb85d68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:13.542546 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6478598a-d901-454d-82b6-be0b0eb85d68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:13.542974 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6478598a-d901-454d-82b6-be0b0eb85d68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:13.672770 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6478598a-d901-454d-82b6-be0b0eb85d68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:13.680340 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6478598a-d901-454d-82b6-be0b0eb85d68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:13.681804 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6478598a-d901-454d-82b6-be0b0eb85d68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:13.682941 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6478598a-d901-454d-82b6-be0b0eb85d68 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1745 microversion: 2.20 time: 0.152401 Dec 20 09:39:13.683488 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 672/1379] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:13 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:14.705759 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a3b2eeb2-0723-4823-9ac2-344daa43fedc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:14.706457 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a3b2eeb2-0723-4823-9ac2-344daa43fedc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:14.712599 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a3b2eeb2-0723-4823-9ac2-344daa43fedc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:14.713052 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a3b2eeb2-0723-4823-9ac2-344daa43fedc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:14.713824 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a3b2eeb2-0723-4823-9ac2-344daa43fedc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:14.714422 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a3b2eeb2-0723-4823-9ac2-344daa43fedc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:14.847526 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a3b2eeb2-0723-4823-9ac2-344daa43fedc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:14.855290 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a3b2eeb2-0723-4823-9ac2-344daa43fedc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:14.856818 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a3b2eeb2-0723-4823-9ac2-344daa43fedc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:14.858508 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a3b2eeb2-0723-4823-9ac2-344daa43fedc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1745 microversion: 2.20 time: 0.157372 Dec 20 09:39:14.859062 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 708/1380] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:14 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:15.876979 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-84a9d746-f27a-4b70-8793-fe2d057047f7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:15.877909 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-84a9d746-f27a-4b70-8793-fe2d057047f7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:15.884663 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-84a9d746-f27a-4b70-8793-fe2d057047f7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:15.885116 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-84a9d746-f27a-4b70-8793-fe2d057047f7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:15.886120 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-84a9d746-f27a-4b70-8793-fe2d057047f7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:15.886764 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-84a9d746-f27a-4b70-8793-fe2d057047f7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:16.026173 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-84a9d746-f27a-4b70-8793-fe2d057047f7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:16.034803 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-84a9d746-f27a-4b70-8793-fe2d057047f7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:16.036369 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-84a9d746-f27a-4b70-8793-fe2d057047f7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:16.037887 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-84a9d746-f27a-4b70-8793-fe2d057047f7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1740 microversion: 2.20 time: 0.164791 Dec 20 09:39:16.048636 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 673/1381] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:15 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:17.056131 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-2f54ce9f-9de4-4e3c-95e7-421c08cc571a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:17.057329 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-2f54ce9f-9de4-4e3c-95e7-421c08cc571a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:17.063946 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2f54ce9f-9de4-4e3c-95e7-421c08cc571a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:17.064386 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2f54ce9f-9de4-4e3c-95e7-421c08cc571a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:17.065434 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2f54ce9f-9de4-4e3c-95e7-421c08cc571a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:17.066039 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2f54ce9f-9de4-4e3c-95e7-421c08cc571a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:17.212114 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-2f54ce9f-9de4-4e3c-95e7-421c08cc571a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:17.221621 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-2f54ce9f-9de4-4e3c-95e7-421c08cc571a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:17.223362 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-2f54ce9f-9de4-4e3c-95e7-421c08cc571a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:17.224760 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-2f54ce9f-9de4-4e3c-95e7-421c08cc571a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1740 microversion: 2.20 time: 0.172289 Dec 20 09:39:17.225536 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 709/1382] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:17 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:18.242560 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-bce650d7-8d86-4fec-83ac-fce56264bbd7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:18.243173 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-bce650d7-8d86-4fec-83ac-fce56264bbd7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:18.249535 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bce650d7-8d86-4fec-83ac-fce56264bbd7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:18.250012 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bce650d7-8d86-4fec-83ac-fce56264bbd7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:18.250798 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bce650d7-8d86-4fec-83ac-fce56264bbd7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:18.251232 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bce650d7-8d86-4fec-83ac-fce56264bbd7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:18.385211 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-bce650d7-8d86-4fec-83ac-fce56264bbd7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:18.403193 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-bce650d7-8d86-4fec-83ac-fce56264bbd7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:18.403193 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-bce650d7-8d86-4fec-83ac-fce56264bbd7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:18.403193 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-bce650d7-8d86-4fec-83ac-fce56264bbd7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1740 microversion: 2.20 time: 0.164587 Dec 20 09:39:18.403777 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 674/1383] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:18 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:19.422673 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-99453909-0c46-435c-b075-663d4fcb4a43 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:19.423267 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-99453909-0c46-435c-b075-663d4fcb4a43 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:19.429589 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-99453909-0c46-435c-b075-663d4fcb4a43 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:19.430034 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-99453909-0c46-435c-b075-663d4fcb4a43 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:19.430816 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-99453909-0c46-435c-b075-663d4fcb4a43 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:19.431256 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-99453909-0c46-435c-b075-663d4fcb4a43 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:19.566495 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-99453909-0c46-435c-b075-663d4fcb4a43 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:19.574450 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-99453909-0c46-435c-b075-663d4fcb4a43 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:19.575967 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-99453909-0c46-435c-b075-663d4fcb4a43 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:19.577116 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-99453909-0c46-435c-b075-663d4fcb4a43 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1740 microversion: 2.20 time: 0.158741 Dec 20 09:39:19.577674 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 710/1384] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:19 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:20.595025 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-eb2f8f41-56f0-46ab-b231-3f0623cefc81 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:20.596300 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-eb2f8f41-56f0-46ab-b231-3f0623cefc81 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:20.602938 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eb2f8f41-56f0-46ab-b231-3f0623cefc81 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:20.603688 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eb2f8f41-56f0-46ab-b231-3f0623cefc81 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:20.604508 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eb2f8f41-56f0-46ab-b231-3f0623cefc81 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:20.604930 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-eb2f8f41-56f0-46ab-b231-3f0623cefc81 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:20.746034 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-eb2f8f41-56f0-46ab-b231-3f0623cefc81 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:20.755015 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-eb2f8f41-56f0-46ab-b231-3f0623cefc81 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:20.756570 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-eb2f8f41-56f0-46ab-b231-3f0623cefc81 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:20.757963 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-eb2f8f41-56f0-46ab-b231-3f0623cefc81 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1740 microversion: 2.20 time: 0.167382 Dec 20 09:39:20.758889 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 675/1385] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:20 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:21.777102 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-46a4db49-87e8-44f1-a525-1f5191cef2b5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:21.777675 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-46a4db49-87e8-44f1-a525-1f5191cef2b5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:21.784740 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-46a4db49-87e8-44f1-a525-1f5191cef2b5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:21.785184 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-46a4db49-87e8-44f1-a525-1f5191cef2b5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:21.785980 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-46a4db49-87e8-44f1-a525-1f5191cef2b5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:21.786412 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-46a4db49-87e8-44f1-a525-1f5191cef2b5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:21.925611 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-46a4db49-87e8-44f1-a525-1f5191cef2b5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:21.933414 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-46a4db49-87e8-44f1-a525-1f5191cef2b5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:21.934897 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-46a4db49-87e8-44f1-a525-1f5191cef2b5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:21.936596 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-46a4db49-87e8-44f1-a525-1f5191cef2b5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1740 microversion: 2.20 time: 0.163506 Dec 20 09:39:21.937160 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 711/1386] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:21 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:22.956358 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-389903d0-215f-4c5b-a0a5-f9f495135568 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:22.957184 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-389903d0-215f-4c5b-a0a5-f9f495135568 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:22.963672 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-389903d0-215f-4c5b-a0a5-f9f495135568 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:22.964138 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-389903d0-215f-4c5b-a0a5-f9f495135568 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:22.964917 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-389903d0-215f-4c5b-a0a5-f9f495135568 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:22.965361 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-389903d0-215f-4c5b-a0a5-f9f495135568 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:23.108550 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-389903d0-215f-4c5b-a0a5-f9f495135568 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:23.117336 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-389903d0-215f-4c5b-a0a5-f9f495135568 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:23.119285 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-389903d0-215f-4c5b-a0a5-f9f495135568 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:23.120491 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-389903d0-215f-4c5b-a0a5-f9f495135568 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1740 microversion: 2.20 time: 0.168348 Dec 20 09:39:23.121256 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 676/1387] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:22 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:24.140643 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d8a5721f-5c8a-42fc-a3db-9686c45e5919 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:24.142147 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d8a5721f-5c8a-42fc-a3db-9686c45e5919 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:24.148940 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d8a5721f-5c8a-42fc-a3db-9686c45e5919 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:24.149663 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d8a5721f-5c8a-42fc-a3db-9686c45e5919 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:24.151332 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d8a5721f-5c8a-42fc-a3db-9686c45e5919 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:24.152236 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d8a5721f-5c8a-42fc-a3db-9686c45e5919 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:24.298391 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d8a5721f-5c8a-42fc-a3db-9686c45e5919 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:24.307375 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d8a5721f-5c8a-42fc-a3db-9686c45e5919 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:24.309097 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d8a5721f-5c8a-42fc-a3db-9686c45e5919 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:24.310285 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d8a5721f-5c8a-42fc-a3db-9686c45e5919 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1740 microversion: 2.20 time: 0.173507 Dec 20 09:39:24.310878 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 712/1388] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:24 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:25.328108 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a947deb7-ec03-4d9c-9fd8-c1ad3fd68abd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:25.328827 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a947deb7-ec03-4d9c-9fd8-c1ad3fd68abd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:25.335193 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a947deb7-ec03-4d9c-9fd8-c1ad3fd68abd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:25.335641 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a947deb7-ec03-4d9c-9fd8-c1ad3fd68abd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:25.336743 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a947deb7-ec03-4d9c-9fd8-c1ad3fd68abd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:25.336939 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a947deb7-ec03-4d9c-9fd8-c1ad3fd68abd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:25.485942 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a947deb7-ec03-4d9c-9fd8-c1ad3fd68abd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:25.494604 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a947deb7-ec03-4d9c-9fd8-c1ad3fd68abd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:25.496279 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a947deb7-ec03-4d9c-9fd8-c1ad3fd68abd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:25.497492 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a947deb7-ec03-4d9c-9fd8-c1ad3fd68abd tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1740 microversion: 2.20 time: 0.173193 Dec 20 09:39:25.498062 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 677/1389] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:25 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:26.519680 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-bebc9d85-7232-497b-a995-de9f4d050e87 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:26.520351 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-bebc9d85-7232-497b-a995-de9f4d050e87 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:26.527297 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bebc9d85-7232-497b-a995-de9f4d050e87 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:26.527774 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bebc9d85-7232-497b-a995-de9f4d050e87 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:26.528580 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bebc9d85-7232-497b-a995-de9f4d050e87 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:26.531592 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bebc9d85-7232-497b-a995-de9f4d050e87 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:26.662602 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-bebc9d85-7232-497b-a995-de9f4d050e87 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:26.670439 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-bebc9d85-7232-497b-a995-de9f4d050e87 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:26.671965 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-bebc9d85-7232-497b-a995-de9f4d050e87 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:26.673157 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-bebc9d85-7232-497b-a995-de9f4d050e87 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1740 microversion: 2.20 time: 0.161623 Dec 20 09:39:26.673718 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 713/1390] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:26 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:27.691343 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d1dc82b6-2a48-47fa-96cf-3e7a185a5fa7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:27.691901 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d1dc82b6-2a48-47fa-96cf-3e7a185a5fa7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:27.698219 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1dc82b6-2a48-47fa-96cf-3e7a185a5fa7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:27.698662 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1dc82b6-2a48-47fa-96cf-3e7a185a5fa7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:27.699440 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1dc82b6-2a48-47fa-96cf-3e7a185a5fa7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:27.699908 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1dc82b6-2a48-47fa-96cf-3e7a185a5fa7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:27.829706 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d1dc82b6-2a48-47fa-96cf-3e7a185a5fa7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:27.837338 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d1dc82b6-2a48-47fa-96cf-3e7a185a5fa7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:27.838818 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d1dc82b6-2a48-47fa-96cf-3e7a185a5fa7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:27.840002 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d1dc82b6-2a48-47fa-96cf-3e7a185a5fa7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1740 microversion: 2.20 time: 0.152452 Dec 20 09:39:27.840832 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 678/1391] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:27 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:28.858109 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-82907472-d3fc-4eeb-84c9-e55ca6e82198 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:28.858744 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-82907472-d3fc-4eeb-84c9-e55ca6e82198 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:28.865330 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-82907472-d3fc-4eeb-84c9-e55ca6e82198 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:28.865775 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-82907472-d3fc-4eeb-84c9-e55ca6e82198 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:28.866545 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-82907472-d3fc-4eeb-84c9-e55ca6e82198 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:28.866978 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-82907472-d3fc-4eeb-84c9-e55ca6e82198 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:28.991473 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-82907472-d3fc-4eeb-84c9-e55ca6e82198 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:28.999183 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-82907472-d3fc-4eeb-84c9-e55ca6e82198 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:29.000761 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-82907472-d3fc-4eeb-84c9-e55ca6e82198 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:29.001907 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-82907472-d3fc-4eeb-84c9-e55ca6e82198 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1722 microversion: 2.20 time: 0.147514 Dec 20 09:39:29.002467 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 714/1392] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:28 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:30.019889 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e953e178-e770-4fda-9a69-0c0ed2641855 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:30.020566 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e953e178-e770-4fda-9a69-0c0ed2641855 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:30.026715 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e953e178-e770-4fda-9a69-0c0ed2641855 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:30.027167 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e953e178-e770-4fda-9a69-0c0ed2641855 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:30.027971 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e953e178-e770-4fda-9a69-0c0ed2641855 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:30.028971 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e953e178-e770-4fda-9a69-0c0ed2641855 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:30.405173 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e953e178-e770-4fda-9a69-0c0ed2641855 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:30.418408 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e953e178-e770-4fda-9a69-0c0ed2641855 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:30.419951 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e953e178-e770-4fda-9a69-0c0ed2641855 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:30.421122 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e953e178-e770-4fda-9a69-0c0ed2641855 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1722 microversion: 2.20 time: 0.404976 Dec 20 09:39:30.421662 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 679/1393] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:30 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1722 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:31.000800 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-e0fcabcf-0eb9-422e-a83f-967079bbefaf req-7c4445d2-52d3-424e-a8f9-69eb805218db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9faf5b6c-7f96-4a91-b944-fd72f5665f64", "name": "network-vif-unplugged", "status": "completed", "tag": "4fac1673-dd2f-4368-bfcc-be873f33a32b"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:39:31.002313 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:39:31.002313 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:39:31.009099 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-e0fcabcf-0eb9-422e-a83f-967079bbefaf req-7c4445d2-52d3-424e-a8f9-69eb805218db service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:31.009540 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-e0fcabcf-0eb9-422e-a83f-967079bbefaf req-7c4445d2-52d3-424e-a8f9-69eb805218db service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:31.020042 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-e0fcabcf-0eb9-422e-a83f-967079bbefaf req-7c4445d2-52d3-424e-a8f9-69eb805218db service nova] Creating event network-vif-unplugged:4fac1673-dd2f-4368-bfcc-be873f33a32b for instance 9faf5b6c-7f96-4a91-b944-fd72f5665f64 on hv-cinder-81908 Dec 20 09:39:31.024910 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-e0fcabcf-0eb9-422e-a83f-967079bbefaf req-7c4445d2-52d3-424e-a8f9-69eb805218db service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145137 Dec 20 09:39:31.025487 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 715/1394] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:39:30 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:39:31.439325 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2fe9b3f1-90c1-4dfc-903c-310472594ab5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:31.439949 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2fe9b3f1-90c1-4dfc-903c-310472594ab5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:31.446270 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2fe9b3f1-90c1-4dfc-903c-310472594ab5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:31.446786 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2fe9b3f1-90c1-4dfc-903c-310472594ab5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:31.447558 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2fe9b3f1-90c1-4dfc-903c-310472594ab5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:31.448019 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2fe9b3f1-90c1-4dfc-903c-310472594ab5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:31.574792 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-2fe9b3f1-90c1-4dfc-903c-310472594ab5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:31.582372 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-2fe9b3f1-90c1-4dfc-903c-310472594ab5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:31.583881 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-2fe9b3f1-90c1-4dfc-903c-310472594ab5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:31.585027 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2fe9b3f1-90c1-4dfc-903c-310472594ab5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1665 microversion: 2.20 time: 0.149398 Dec 20 09:39:31.585589 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 680/1395] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:31 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1665 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:31.603601 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3b318020-6165-41a4-814b-9a4c9547000d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "413873cb-ea94-4695-a8bd-57b40da7f9fc"}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:39:31.604833 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-3b318020-6165-41a4-814b-9a4c9547000d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:31.611510 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3b318020-6165-41a4-814b-9a4c9547000d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:31.612010 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3b318020-6165-41a4-814b-9a4c9547000d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:31.612784 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3b318020-6165-41a4-814b-9a4c9547000d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:31.613468 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3b318020-6165-41a4-814b-9a4c9547000d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:32.431087 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3b318020-6165-41a4-814b-9a4c9547000d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.831498 Dec 20 09:39:32.432087 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 716/1396] 10.222.0.62 () {62 vars in 1363 bytes} [Mon Dec 20 09:39:31 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/os-volume_attachments => generated 188 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:39:32.538446 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9d31de83-0bb9-493f-9947-327a44d5c8fc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:32.538964 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9d31de83-0bb9-493f-9947-327a44d5c8fc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:32.545539 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9d31de83-0bb9-493f-9947-327a44d5c8fc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:32.545977 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9d31de83-0bb9-493f-9947-327a44d5c8fc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:32.546764 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9d31de83-0bb9-493f-9947-327a44d5c8fc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:32.547189 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9d31de83-0bb9-493f-9947-327a44d5c8fc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:33.081420 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9d31de83-0bb9-493f-9947-327a44d5c8fc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/os-volume_attachments/413873cb-ea94-4695-a8bd-57b40da7f9fc" status: 202 len: 0 microversion: 2.20 time: 0.546518 Dec 20 09:39:33.081940 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 681/1397] 10.222.0.62 () {60 vars in 1456 bytes} [Mon Dec 20 09:39:32 2021] DELETE /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/os-volume_attachments/413873cb-ea94-4695-a8bd-57b40da7f9fc => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 20 09:39:33.134801 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9cd4230a-43fc-4afa-a585-5b73bbe0d7b5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:39:33.135371 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9cd4230a-43fc-4afa-a585-5b73bbe0d7b5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:33.141617 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9cd4230a-43fc-4afa-a585-5b73bbe0d7b5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:33.142074 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9cd4230a-43fc-4afa-a585-5b73bbe0d7b5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:33.142853 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9cd4230a-43fc-4afa-a585-5b73bbe0d7b5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:33.143292 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9cd4230a-43fc-4afa-a585-5b73bbe0d7b5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:33.359040 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9cd4230a-43fc-4afa-a585-5b73bbe0d7b5 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action" status: 202 len: 0 microversion: 2.20 time: 0.227777 Dec 20 09:39:33.362585 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 717/1398] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 20 09:39:33 2021] POST /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 20 09:39:33.368010 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-cb679a8f-de82-4a38-9054-2e440bb94d67 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:33.369355 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-cb679a8f-de82-4a38-9054-2e440bb94d67 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:33.376611 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cb679a8f-de82-4a38-9054-2e440bb94d67 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:33.377068 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cb679a8f-de82-4a38-9054-2e440bb94d67 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:33.377916 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cb679a8f-de82-4a38-9054-2e440bb94d67 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:33.378300 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cb679a8f-de82-4a38-9054-2e440bb94d67 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:33.513676 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-cb679a8f-de82-4a38-9054-2e440bb94d67 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:33.521830 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-cb679a8f-de82-4a38-9054-2e440bb94d67 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:33.523320 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-cb679a8f-de82-4a38-9054-2e440bb94d67 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:33.524505 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-cb679a8f-de82-4a38-9054-2e440bb94d67 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1673 microversion: 2.20 time: 0.160273 Dec 20 09:39:33.525064 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 682/1399] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:33 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:34.542903 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-243434a2-cb4a-4c13-a1df-ff8256db791e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:34.543508 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-243434a2-cb4a-4c13-a1df-ff8256db791e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:34.549913 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-243434a2-cb4a-4c13-a1df-ff8256db791e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:34.550360 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-243434a2-cb4a-4c13-a1df-ff8256db791e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:34.551131 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-243434a2-cb4a-4c13-a1df-ff8256db791e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:34.551569 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-243434a2-cb4a-4c13-a1df-ff8256db791e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:34.682815 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-243434a2-cb4a-4c13-a1df-ff8256db791e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:34.690821 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-243434a2-cb4a-4c13-a1df-ff8256db791e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:34.692379 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-243434a2-cb4a-4c13-a1df-ff8256db791e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:34.693540 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-243434a2-cb4a-4c13-a1df-ff8256db791e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1673 microversion: 2.20 time: 0.154863 Dec 20 09:39:34.694226 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 718/1400] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:34 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:34.770582 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9f0e20f0-0786-4eee-8a22-fafa347ae38f tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:39:34.771139 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9f0e20f0-0786-4eee-8a22-fafa347ae38f tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:34.777477 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9f0e20f0-0786-4eee-8a22-fafa347ae38f tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:34.777917 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9f0e20f0-0786-4eee-8a22-fafa347ae38f tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:34.779336 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9f0e20f0-0786-4eee-8a22-fafa347ae38f tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:34.779806 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9f0e20f0-0786-4eee-8a22-fafa347ae38f tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:34.801996 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.objects.instance [None req-9f0e20f0-0786-4eee-8a22-fafa347ae38f tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lazy-loading 'flavor' on Instance uuid b2454a5d-038c-422c-8b61-b88674e18a3c {{(pid=116675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:39:35.052353 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9f0e20f0-0786-4eee-8a22-fafa347ae38f tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "POST /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c/action" status: 202 len: 0 microversion: 2.1 time: 0.285125 Dec 20 09:39:35.052845 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 683/1401] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:39:34 2021] POST /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:39:35.061920 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3798cf5e-cfab-465d-8ac4-714886b7347d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:35.062543 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-3798cf5e-cfab-465d-8ac4-714886b7347d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:35.068656 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3798cf5e-cfab-465d-8ac4-714886b7347d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:35.069101 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3798cf5e-cfab-465d-8ac4-714886b7347d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:35.069886 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3798cf5e-cfab-465d-8ac4-714886b7347d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:35.070321 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3798cf5e-cfab-465d-8ac4-714886b7347d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:35.203649 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3798cf5e-cfab-465d-8ac4-714886b7347d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:35.210853 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3798cf5e-cfab-465d-8ac4-714886b7347d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1569 microversion: 2.1 time: 0.153586 Dec 20 09:39:35.211418 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 719/1402] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:35 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:35.711774 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-96eadcc6-3dc1-4978-a069-f3a78ab937b2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:35.713698 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-96eadcc6-3dc1-4978-a069-f3a78ab937b2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:35.718668 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-96eadcc6-3dc1-4978-a069-f3a78ab937b2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:35.719115 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-96eadcc6-3dc1-4978-a069-f3a78ab937b2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:35.719932 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-96eadcc6-3dc1-4978-a069-f3a78ab937b2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:35.720413 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-96eadcc6-3dc1-4978-a069-f3a78ab937b2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:35.851899 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-96eadcc6-3dc1-4978-a069-f3a78ab937b2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:35.860436 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-96eadcc6-3dc1-4978-a069-f3a78ab937b2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:35.861924 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-96eadcc6-3dc1-4978-a069-f3a78ab937b2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:35.863633 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-96eadcc6-3dc1-4978-a069-f3a78ab937b2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1731 microversion: 2.20 time: 0.156017 Dec 20 09:39:35.864244 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 684/1403] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:35 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:39:36.227636 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-500dba59-b25c-493c-b40b-31b691c06603 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:36.228309 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-500dba59-b25c-493c-b40b-31b691c06603 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:36.235286 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-500dba59-b25c-493c-b40b-31b691c06603 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:36.235781 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-500dba59-b25c-493c-b40b-31b691c06603 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:36.236579 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-500dba59-b25c-493c-b40b-31b691c06603 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:36.237049 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-500dba59-b25c-493c-b40b-31b691c06603 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:36.379871 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-500dba59-b25c-493c-b40b-31b691c06603 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:36.387170 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-500dba59-b25c-493c-b40b-31b691c06603 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1569 microversion: 2.1 time: 0.163135 Dec 20 09:39:36.388322 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 720/1404] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:36 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:36.882319 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-323638eb-e4c8-40e5-ad93-5ecbc8164bb7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:36.883066 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-323638eb-e4c8-40e5-ad93-5ecbc8164bb7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:36.889966 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-323638eb-e4c8-40e5-ad93-5ecbc8164bb7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:36.890403 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-323638eb-e4c8-40e5-ad93-5ecbc8164bb7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:36.891305 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-323638eb-e4c8-40e5-ad93-5ecbc8164bb7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:36.891760 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-323638eb-e4c8-40e5-ad93-5ecbc8164bb7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:37.035995 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-323638eb-e4c8-40e5-ad93-5ecbc8164bb7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:37.044805 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-323638eb-e4c8-40e5-ad93-5ecbc8164bb7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:37.046297 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-323638eb-e4c8-40e5-ad93-5ecbc8164bb7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:37.047471 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-323638eb-e4c8-40e5-ad93-5ecbc8164bb7 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1731 microversion: 2.20 time: 0.168955 Dec 20 09:39:37.048096 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 685/1405] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:36 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:37.410510 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0887141f-8946-43f9-b59e-40f8319f94f6 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:37.410911 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0887141f-8946-43f9-b59e-40f8319f94f6 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:37.417224 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0887141f-8946-43f9-b59e-40f8319f94f6 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:37.417726 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0887141f-8946-43f9-b59e-40f8319f94f6 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:37.418590 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0887141f-8946-43f9-b59e-40f8319f94f6 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:37.419608 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0887141f-8946-43f9-b59e-40f8319f94f6 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:37.559375 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-0887141f-8946-43f9-b59e-40f8319f94f6 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:37.567090 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0887141f-8946-43f9-b59e-40f8319f94f6 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1569 microversion: 2.1 time: 0.160697 Dec 20 09:39:37.567789 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 721/1406] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:37 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:38.066045 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-06928884-a45b-40e3-8e43-cb5168deffa4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:38.067097 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-06928884-a45b-40e3-8e43-cb5168deffa4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:38.073397 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-06928884-a45b-40e3-8e43-cb5168deffa4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:38.073843 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-06928884-a45b-40e3-8e43-cb5168deffa4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:38.074627 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-06928884-a45b-40e3-8e43-cb5168deffa4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:38.075064 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-06928884-a45b-40e3-8e43-cb5168deffa4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:38.208435 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-06928884-a45b-40e3-8e43-cb5168deffa4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:38.216417 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-06928884-a45b-40e3-8e43-cb5168deffa4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:38.217910 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-06928884-a45b-40e3-8e43-cb5168deffa4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:38.219283 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-06928884-a45b-40e3-8e43-cb5168deffa4 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1731 microversion: 2.20 time: 0.157447 Dec 20 09:39:38.219872 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 686/1407] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:38 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:38.583682 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4fbcee81-944e-41f1-8552-9050e6264412 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:38.584302 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-4fbcee81-944e-41f1-8552-9050e6264412 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:38.592156 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4fbcee81-944e-41f1-8552-9050e6264412 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:38.592156 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4fbcee81-944e-41f1-8552-9050e6264412 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:38.592156 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4fbcee81-944e-41f1-8552-9050e6264412 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:38.593176 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4fbcee81-944e-41f1-8552-9050e6264412 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:38.754162 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-4fbcee81-944e-41f1-8552-9050e6264412 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:38.761680 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-4fbcee81-944e-41f1-8552-9050e6264412 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1569 microversion: 2.1 time: 0.181797 Dec 20 09:39:38.762259 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 722/1408] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:38 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:39.038620 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c9b47031-31a9-4160-bbdf-d5947ebec60c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:39.039583 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c9b47031-31a9-4160-bbdf-d5947ebec60c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:39.046568 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9b47031-31a9-4160-bbdf-d5947ebec60c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:39.047016 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9b47031-31a9-4160-bbdf-d5947ebec60c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:39.047834 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9b47031-31a9-4160-bbdf-d5947ebec60c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:39.048280 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c9b47031-31a9-4160-bbdf-d5947ebec60c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:39.075860 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c9b47031-31a9-4160-bbdf-d5947ebec60c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041015 Dec 20 09:39:39.076473 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 687/1409] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:39:39 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 09:39:39.141812 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-2eb9d33b-8011-431d-beff-bc893958fbcc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:39.142300 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-2eb9d33b-8011-431d-beff-bc893958fbcc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:39.148222 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2eb9d33b-8011-431d-beff-bc893958fbcc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:39.148669 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2eb9d33b-8011-431d-beff-bc893958fbcc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:39.149433 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2eb9d33b-8011-431d-beff-bc893958fbcc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:39.149859 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2eb9d33b-8011-431d-beff-bc893958fbcc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:39.175559 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-2eb9d33b-8011-431d-beff-bc893958fbcc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Going to try to terminate instance {{(pid=116674) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 09:39:39.238158 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-fd6eddd7-16da-4c3e-b362-499f65f6a156 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:39.238782 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-fd6eddd7-16da-4c3e-b362-499f65f6a156 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:39.244949 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fd6eddd7-16da-4c3e-b362-499f65f6a156 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:39.245331 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fd6eddd7-16da-4c3e-b362-499f65f6a156 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:39.246119 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fd6eddd7-16da-4c3e-b362-499f65f6a156 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:39.246555 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fd6eddd7-16da-4c3e-b362-499f65f6a156 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:39.389913 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-fd6eddd7-16da-4c3e-b362-499f65f6a156 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:39.398142 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-fd6eddd7-16da-4c3e-b362-499f65f6a156 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:39.399709 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-fd6eddd7-16da-4c3e-b362-499f65f6a156 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:39.400873 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-fd6eddd7-16da-4c3e-b362-499f65f6a156 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1731 microversion: 2.20 time: 0.166909 Dec 20 09:39:39.401439 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 688/1410] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:39 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:39:39.408385 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-2eb9d33b-8011-431d-beff-bc893958fbcc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 204 len: 0 microversion: 2.1 time: 0.269960 Dec 20 09:39:39.409117 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 723/1411] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 20 09:39:39 2021] DELETE /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 09:39:39.417107 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e624c8b1-9b53-4693-adf6-a8447f034349 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:39.417893 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e624c8b1-9b53-4693-adf6-a8447f034349 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:39.424248 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e624c8b1-9b53-4693-adf6-a8447f034349 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:39.425887 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e624c8b1-9b53-4693-adf6-a8447f034349 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:39.425887 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e624c8b1-9b53-4693-adf6-a8447f034349 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:39.425887 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e624c8b1-9b53-4693-adf6-a8447f034349 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:39.564934 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e624c8b1-9b53-4693-adf6-a8447f034349 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:39.572667 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e624c8b1-9b53-4693-adf6-a8447f034349 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1672 microversion: 2.1 time: 0.159627 Dec 20 09:39:39.573468 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 689/1412] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:39 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:39.778889 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-697144f1-7483-4b0b-9ddd-8323b5abc733 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:39.779504 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-697144f1-7483-4b0b-9ddd-8323b5abc733 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:39.785425 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-697144f1-7483-4b0b-9ddd-8323b5abc733 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:39.785881 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-697144f1-7483-4b0b-9ddd-8323b5abc733 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:39.786660 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-697144f1-7483-4b0b-9ddd-8323b5abc733 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:39.787102 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-697144f1-7483-4b0b-9ddd-8323b5abc733 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:39.923265 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-697144f1-7483-4b0b-9ddd-8323b5abc733 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:39.931952 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-697144f1-7483-4b0b-9ddd-8323b5abc733 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1569 microversion: 2.1 time: 0.157248 Dec 20 09:39:39.932880 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 724/1413] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:39 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:40.420096 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f67ed7cd-c8aa-478c-959c-b18170ab42e1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:40.420707 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f67ed7cd-c8aa-478c-959c-b18170ab42e1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:40.427347 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f67ed7cd-c8aa-478c-959c-b18170ab42e1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:40.427860 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f67ed7cd-c8aa-478c-959c-b18170ab42e1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:40.428643 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f67ed7cd-c8aa-478c-959c-b18170ab42e1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:40.429078 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f67ed7cd-c8aa-478c-959c-b18170ab42e1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:40.569803 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f67ed7cd-c8aa-478c-959c-b18170ab42e1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:40.577626 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f67ed7cd-c8aa-478c-959c-b18170ab42e1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:40.579108 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f67ed7cd-c8aa-478c-959c-b18170ab42e1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:40.580283 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f67ed7cd-c8aa-478c-959c-b18170ab42e1 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1731 microversion: 2.20 time: 0.164566 Dec 20 09:39:40.580845 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 690/1414] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:40 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:40.590018 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-52d44a7c-a365-4512-9394-2c4a4c495326 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:40.591161 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-52d44a7c-a365-4512-9394-2c4a4c495326 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:40.598471 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-52d44a7c-a365-4512-9394-2c4a4c495326 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:40.598922 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-52d44a7c-a365-4512-9394-2c4a4c495326 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:40.599743 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-52d44a7c-a365-4512-9394-2c4a4c495326 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:40.600293 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-52d44a7c-a365-4512-9394-2c4a4c495326 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:40.740633 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-52d44a7c-a365-4512-9394-2c4a4c495326 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:40.748529 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-52d44a7c-a365-4512-9394-2c4a4c495326 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1672 microversion: 2.1 time: 0.162180 Dec 20 09:39:40.749319 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 725/1415] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:40 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:40.949763 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-75d32666-88cb-4af3-b0ee-9dbe93871be0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:40.950295 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-75d32666-88cb-4af3-b0ee-9dbe93871be0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:40.956299 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-75d32666-88cb-4af3-b0ee-9dbe93871be0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:40.956744 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-75d32666-88cb-4af3-b0ee-9dbe93871be0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:40.957525 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-75d32666-88cb-4af3-b0ee-9dbe93871be0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:40.957965 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-75d32666-88cb-4af3-b0ee-9dbe93871be0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:41.091011 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-75d32666-88cb-4af3-b0ee-9dbe93871be0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:41.098271 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-75d32666-88cb-4af3-b0ee-9dbe93871be0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1569 microversion: 2.1 time: 0.152247 Dec 20 09:39:41.098844 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 691/1416] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:40 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:41.597938 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-36a9ad2f-6285-4af1-9402-8863d5139496 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:41.598479 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-36a9ad2f-6285-4af1-9402-8863d5139496 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:41.604779 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-36a9ad2f-6285-4af1-9402-8863d5139496 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:41.605231 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-36a9ad2f-6285-4af1-9402-8863d5139496 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:41.606016 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-36a9ad2f-6285-4af1-9402-8863d5139496 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:41.606457 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-36a9ad2f-6285-4af1-9402-8863d5139496 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:41.746102 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-36a9ad2f-6285-4af1-9402-8863d5139496 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:41.754073 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-36a9ad2f-6285-4af1-9402-8863d5139496 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:41.755735 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-36a9ad2f-6285-4af1-9402-8863d5139496 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:41.757033 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-36a9ad2f-6285-4af1-9402-8863d5139496 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1731 microversion: 2.20 time: 0.162836 Dec 20 09:39:41.757550 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 726/1417] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:41 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:41.765427 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9f386a96-19e9-4aa1-be51-b41efd68dd98 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:41.778940 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9f386a96-19e9-4aa1-be51-b41efd68dd98 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:41.778940 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9f386a96-19e9-4aa1-be51-b41efd68dd98 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:41.778940 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9f386a96-19e9-4aa1-be51-b41efd68dd98 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:41.778940 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9f386a96-19e9-4aa1-be51-b41efd68dd98 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:41.779356 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9f386a96-19e9-4aa1-be51-b41efd68dd98 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:41.913369 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-9f386a96-19e9-4aa1-be51-b41efd68dd98 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:41.920999 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9f386a96-19e9-4aa1-be51-b41efd68dd98 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1672 microversion: 2.1 time: 0.159710 Dec 20 09:39:41.921636 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 692/1418] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:41 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:42.115762 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-324bc869-d7f9-47d8-93b0-52506bd72dfb tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:42.116461 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-324bc869-d7f9-47d8-93b0-52506bd72dfb tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:42.123197 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-324bc869-d7f9-47d8-93b0-52506bd72dfb tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:42.123750 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-324bc869-d7f9-47d8-93b0-52506bd72dfb tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:42.124622 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-324bc869-d7f9-47d8-93b0-52506bd72dfb tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:42.125133 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-324bc869-d7f9-47d8-93b0-52506bd72dfb tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:42.264486 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-324bc869-d7f9-47d8-93b0-52506bd72dfb tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:42.272920 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-324bc869-d7f9-47d8-93b0-52506bd72dfb tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1569 microversion: 2.1 time: 0.161138 Dec 20 09:39:42.273797 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 727/1419] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:42 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:42.774610 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f8000e2f-bb72-4fb6-9e18-e97a659a158e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:42.775195 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f8000e2f-bb72-4fb6-9e18-e97a659a158e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:42.782460 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f8000e2f-bb72-4fb6-9e18-e97a659a158e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:42.783016 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f8000e2f-bb72-4fb6-9e18-e97a659a158e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:42.783906 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f8000e2f-bb72-4fb6-9e18-e97a659a158e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:42.784413 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f8000e2f-bb72-4fb6-9e18-e97a659a158e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:42.918536 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f8000e2f-bb72-4fb6-9e18-e97a659a158e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:42.929034 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f8000e2f-bb72-4fb6-9e18-e97a659a158e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:42.931265 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f8000e2f-bb72-4fb6-9e18-e97a659a158e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:42.932476 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f8000e2f-bb72-4fb6-9e18-e97a659a158e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1731 microversion: 2.20 time: 0.161597 Dec 20 09:39:42.938754 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 693/1420] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:42 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:42.943601 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d5870c0f-a480-4030-a0df-586e9f0b527f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:42.944243 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d5870c0f-a480-4030-a0df-586e9f0b527f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:42.950958 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d5870c0f-a480-4030-a0df-586e9f0b527f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:42.951401 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d5870c0f-a480-4030-a0df-586e9f0b527f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:42.952213 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d5870c0f-a480-4030-a0df-586e9f0b527f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:42.952646 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d5870c0f-a480-4030-a0df-586e9f0b527f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:43.084719 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d5870c0f-a480-4030-a0df-586e9f0b527f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:43.092877 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d5870c0f-a480-4030-a0df-586e9f0b527f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1672 microversion: 2.1 time: 0.152866 Dec 20 09:39:43.093464 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 728/1421] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:42 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:43.289795 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f3a88293-afa2-4c06-9dec-4526b9bd7ce0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:43.294713 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f3a88293-afa2-4c06-9dec-4526b9bd7ce0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:43.301218 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f3a88293-afa2-4c06-9dec-4526b9bd7ce0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:43.301672 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f3a88293-afa2-4c06-9dec-4526b9bd7ce0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:43.302468 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f3a88293-afa2-4c06-9dec-4526b9bd7ce0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:43.302904 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f3a88293-afa2-4c06-9dec-4526b9bd7ce0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:43.441974 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f3a88293-afa2-4c06-9dec-4526b9bd7ce0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:43.450653 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f3a88293-afa2-4c06-9dec-4526b9bd7ce0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1569 microversion: 2.1 time: 0.163916 Dec 20 09:39:43.455959 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 694/1422] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:43 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:43.950157 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a2064fc7-ea8d-422a-b210-116b9299a315 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:43.950747 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a2064fc7-ea8d-422a-b210-116b9299a315 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:43.957262 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a2064fc7-ea8d-422a-b210-116b9299a315 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:43.957715 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a2064fc7-ea8d-422a-b210-116b9299a315 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:43.958526 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a2064fc7-ea8d-422a-b210-116b9299a315 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:43.959027 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a2064fc7-ea8d-422a-b210-116b9299a315 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:44.104303 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a2064fc7-ea8d-422a-b210-116b9299a315 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:44.111834 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-09718fef-399c-4ac6-bd58-fc973f4baffc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:44.112438 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-09718fef-399c-4ac6-bd58-fc973f4baffc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:44.124603 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a2064fc7-ea8d-422a-b210-116b9299a315 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:44.126078 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a2064fc7-ea8d-422a-b210-116b9299a315 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:44.128070 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-09718fef-399c-4ac6-bd58-fc973f4baffc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:44.128502 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-09718fef-399c-4ac6-bd58-fc973f4baffc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:44.129320 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-09718fef-399c-4ac6-bd58-fc973f4baffc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:44.129756 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-09718fef-399c-4ac6-bd58-fc973f4baffc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:44.133575 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a2064fc7-ea8d-422a-b210-116b9299a315 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1731 microversion: 2.20 time: 0.187099 Dec 20 09:39:44.134148 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 729/1423] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:43 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:44.266108 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-09718fef-399c-4ac6-bd58-fc973f4baffc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:44.273424 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-09718fef-399c-4ac6-bd58-fc973f4baffc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1672 microversion: 2.1 time: 0.165257 Dec 20 09:39:44.274024 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 695/1424] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:44 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:39:44.467732 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8498de2c-9587-4d16-b53f-168ebf434cf8 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:44.468341 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-8498de2c-9587-4d16-b53f-168ebf434cf8 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:44.474259 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8498de2c-9587-4d16-b53f-168ebf434cf8 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:44.474712 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8498de2c-9587-4d16-b53f-168ebf434cf8 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:44.475495 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8498de2c-9587-4d16-b53f-168ebf434cf8 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:44.475957 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8498de2c-9587-4d16-b53f-168ebf434cf8 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:44.611979 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-8498de2c-9587-4d16-b53f-168ebf434cf8 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:44.619928 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8498de2c-9587-4d16-b53f-168ebf434cf8 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1569 microversion: 2.1 time: 0.156086 Dec 20 09:39:44.620864 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 730/1425] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:44 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:45.150575 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6931b693-c4b5-40a9-ab54-12083ac39e32 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:45.151184 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6931b693-c4b5-40a9-ab54-12083ac39e32 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:45.157905 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6931b693-c4b5-40a9-ab54-12083ac39e32 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:45.158344 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6931b693-c4b5-40a9-ab54-12083ac39e32 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:45.159106 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6931b693-c4b5-40a9-ab54-12083ac39e32 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:45.159535 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6931b693-c4b5-40a9-ab54-12083ac39e32 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:45.290682 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d48dfc47-bef6-432c-a806-f716f3d79888 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:45.291510 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d48dfc47-bef6-432c-a806-f716f3d79888 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:45.298383 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d48dfc47-bef6-432c-a806-f716f3d79888 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:45.298598 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6931b693-c4b5-40a9-ab54-12083ac39e32 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:45.298868 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d48dfc47-bef6-432c-a806-f716f3d79888 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:45.299780 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d48dfc47-bef6-432c-a806-f716f3d79888 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:45.300462 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d48dfc47-bef6-432c-a806-f716f3d79888 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:45.307276 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6931b693-c4b5-40a9-ab54-12083ac39e32 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:45.309030 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6931b693-c4b5-40a9-ab54-12083ac39e32 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:45.310278 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6931b693-c4b5-40a9-ab54-12083ac39e32 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1731 microversion: 2.20 time: 0.163355 Dec 20 09:39:45.310839 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 696/1426] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:45 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:45.440334 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d48dfc47-bef6-432c-a806-f716f3d79888 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:45.447588 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d48dfc47-bef6-432c-a806-f716f3d79888 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1672 microversion: 2.1 time: 0.160734 Dec 20 09:39:45.448177 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 731/1427] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:45 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:39:45.637922 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a7b1b62c-9278-4306-8659-4c705c6180cd tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:45.638545 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a7b1b62c-9278-4306-8659-4c705c6180cd tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:45.644721 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a7b1b62c-9278-4306-8659-4c705c6180cd tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:45.645175 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a7b1b62c-9278-4306-8659-4c705c6180cd tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:45.645980 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a7b1b62c-9278-4306-8659-4c705c6180cd tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:45.646418 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a7b1b62c-9278-4306-8659-4c705c6180cd tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:45.788533 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a7b1b62c-9278-4306-8659-4c705c6180cd tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:45.797113 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a7b1b62c-9278-4306-8659-4c705c6180cd tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1569 microversion: 2.1 time: 0.163375 Dec 20 09:39:45.798823 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 697/1428] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:45 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:46.327962 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a780fdb8-6eed-4229-8875-6cf6e0a1c578 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:46.328740 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a780fdb8-6eed-4229-8875-6cf6e0a1c578 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:46.335318 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a780fdb8-6eed-4229-8875-6cf6e0a1c578 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:46.335803 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a780fdb8-6eed-4229-8875-6cf6e0a1c578 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:46.336602 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a780fdb8-6eed-4229-8875-6cf6e0a1c578 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:46.337048 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a780fdb8-6eed-4229-8875-6cf6e0a1c578 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:46.465928 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-19be5e86-89dc-4afd-a778-a93401fa8672 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:46.466538 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-19be5e86-89dc-4afd-a778-a93401fa8672 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:46.473042 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-19be5e86-89dc-4afd-a778-a93401fa8672 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:46.473504 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-19be5e86-89dc-4afd-a778-a93401fa8672 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:46.474310 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-19be5e86-89dc-4afd-a778-a93401fa8672 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:46.474748 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-19be5e86-89dc-4afd-a778-a93401fa8672 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:46.478368 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a780fdb8-6eed-4229-8875-6cf6e0a1c578 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:46.486250 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a780fdb8-6eed-4229-8875-6cf6e0a1c578 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:46.488039 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a780fdb8-6eed-4229-8875-6cf6e0a1c578 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:46.489227 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a780fdb8-6eed-4229-8875-6cf6e0a1c578 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1731 microversion: 2.20 time: 0.165568 Dec 20 09:39:46.489810 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 732/1429] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:46 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:46.613276 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-19be5e86-89dc-4afd-a778-a93401fa8672 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:46.620621 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-19be5e86-89dc-4afd-a778-a93401fa8672 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1672 microversion: 2.1 time: 0.158390 Dec 20 09:39:46.621191 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 698/1430] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:46 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:46.814667 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9b918385-2ee4-4742-9ba3-8bb267c55264 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:46.815265 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9b918385-2ee4-4742-9ba3-8bb267c55264 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:46.821240 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9b918385-2ee4-4742-9ba3-8bb267c55264 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:46.821685 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9b918385-2ee4-4742-9ba3-8bb267c55264 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:46.822454 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9b918385-2ee4-4742-9ba3-8bb267c55264 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:46.822890 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9b918385-2ee4-4742-9ba3-8bb267c55264 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:46.972805 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-9b918385-2ee4-4742-9ba3-8bb267c55264 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:46.980537 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9b918385-2ee4-4742-9ba3-8bb267c55264 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1569 microversion: 2.1 time: 0.169464 Dec 20 09:39:46.981707 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 733/1431] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:46 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:47.508852 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1cdc48e7-fe09-4f6b-b2e9-2d6f9d05d4cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:47.509590 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1cdc48e7-fe09-4f6b-b2e9-2d6f9d05d4cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:47.517094 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1cdc48e7-fe09-4f6b-b2e9-2d6f9d05d4cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:47.517538 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1cdc48e7-fe09-4f6b-b2e9-2d6f9d05d4cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:47.518360 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1cdc48e7-fe09-4f6b-b2e9-2d6f9d05d4cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:47.518936 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1cdc48e7-fe09-4f6b-b2e9-2d6f9d05d4cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:47.638251 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1e812ddf-0ab7-4dd9-a42e-cb4b4e1b3194 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:47.638980 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-1e812ddf-0ab7-4dd9-a42e-cb4b4e1b3194 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:47.645611 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1e812ddf-0ab7-4dd9-a42e-cb4b4e1b3194 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:47.646277 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1e812ddf-0ab7-4dd9-a42e-cb4b4e1b3194 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:47.647233 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1e812ddf-0ab7-4dd9-a42e-cb4b4e1b3194 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:47.647897 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1e812ddf-0ab7-4dd9-a42e-cb4b4e1b3194 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:47.664422 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1cdc48e7-fe09-4f6b-b2e9-2d6f9d05d4cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:47.673320 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1cdc48e7-fe09-4f6b-b2e9-2d6f9d05d4cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:47.675254 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1cdc48e7-fe09-4f6b-b2e9-2d6f9d05d4cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:47.677142 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1cdc48e7-fe09-4f6b-b2e9-2d6f9d05d4cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1731 microversion: 2.20 time: 0.172935 Dec 20 09:39:47.679564 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 699/1432] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:47 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:47.788828 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1e812ddf-0ab7-4dd9-a42e-cb4b4e1b3194 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:47.796200 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1e812ddf-0ab7-4dd9-a42e-cb4b4e1b3194 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1672 microversion: 2.1 time: 0.162038 Dec 20 09:39:47.796657 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 734/1433] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:47 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:47.999118 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-7ea60af0-bd38-4148-9717-51ce39e45480 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:47.999759 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-7ea60af0-bd38-4148-9717-51ce39e45480 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:48.005846 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7ea60af0-bd38-4148-9717-51ce39e45480 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:48.006301 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7ea60af0-bd38-4148-9717-51ce39e45480 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:48.007083 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7ea60af0-bd38-4148-9717-51ce39e45480 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:48.007521 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-7ea60af0-bd38-4148-9717-51ce39e45480 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:48.142175 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-7ea60af0-bd38-4148-9717-51ce39e45480 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:48.149499 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-7ea60af0-bd38-4148-9717-51ce39e45480 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1569 microversion: 2.1 time: 0.154619 Dec 20 09:39:48.150073 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 700/1434] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:47 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:48.696214 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7c12857a-be23-44ac-b74b-2ed5a8e4010a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:48.696823 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7c12857a-be23-44ac-b74b-2ed5a8e4010a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:48.704834 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7c12857a-be23-44ac-b74b-2ed5a8e4010a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:48.705288 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7c12857a-be23-44ac-b74b-2ed5a8e4010a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:48.706244 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7c12857a-be23-44ac-b74b-2ed5a8e4010a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:48.706678 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7c12857a-be23-44ac-b74b-2ed5a8e4010a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:48.812580 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4fd57a1f-2b72-4d33-97ac-6fc53aaca94a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:48.813188 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4fd57a1f-2b72-4d33-97ac-6fc53aaca94a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:48.822730 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4fd57a1f-2b72-4d33-97ac-6fc53aaca94a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:48.823185 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4fd57a1f-2b72-4d33-97ac-6fc53aaca94a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:48.824001 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4fd57a1f-2b72-4d33-97ac-6fc53aaca94a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:48.824578 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4fd57a1f-2b72-4d33-97ac-6fc53aaca94a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:48.874794 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7c12857a-be23-44ac-b74b-2ed5a8e4010a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:48.886412 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7c12857a-be23-44ac-b74b-2ed5a8e4010a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:48.889278 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7c12857a-be23-44ac-b74b-2ed5a8e4010a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:48.891428 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7c12857a-be23-44ac-b74b-2ed5a8e4010a tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1731 microversion: 2.20 time: 0.198934 Dec 20 09:39:48.892489 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 735/1435] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:48 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:48.980594 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-4fd57a1f-2b72-4d33-97ac-6fc53aaca94a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:48.988857 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4fd57a1f-2b72-4d33-97ac-6fc53aaca94a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1672 microversion: 2.1 time: 0.179888 Dec 20 09:39:48.989436 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 701/1436] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:48 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1672 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:39:49.169367 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0431b445-25c9-4d0f-9ed9-851e0f006d41 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:49.169972 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0431b445-25c9-4d0f-9ed9-851e0f006d41 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:49.176083 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0431b445-25c9-4d0f-9ed9-851e0f006d41 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:49.176548 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0431b445-25c9-4d0f-9ed9-851e0f006d41 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:49.177317 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0431b445-25c9-4d0f-9ed9-851e0f006d41 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:49.177756 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0431b445-25c9-4d0f-9ed9-851e0f006d41 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:49.321481 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-0431b445-25c9-4d0f-9ed9-851e0f006d41 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:49.329596 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0431b445-25c9-4d0f-9ed9-851e0f006d41 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1569 microversion: 2.1 time: 0.163901 Dec 20 09:39:49.330170 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 736/1437] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:49 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:49.912523 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ab42408a-4430-4859-9a16-2355fd8cb8ec tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:49.913163 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ab42408a-4430-4859-9a16-2355fd8cb8ec tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:49.920281 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ab42408a-4430-4859-9a16-2355fd8cb8ec tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:49.920730 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ab42408a-4430-4859-9a16-2355fd8cb8ec tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:49.921507 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ab42408a-4430-4859-9a16-2355fd8cb8ec tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:49.921941 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ab42408a-4430-4859-9a16-2355fd8cb8ec tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:50.005673 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b8f0ffb7-ef5d-40b1-80fa-dc21c64232bd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:50.006289 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b8f0ffb7-ef5d-40b1-80fa-dc21c64232bd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:50.012663 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b8f0ffb7-ef5d-40b1-80fa-dc21c64232bd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:50.013114 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b8f0ffb7-ef5d-40b1-80fa-dc21c64232bd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:50.013907 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b8f0ffb7-ef5d-40b1-80fa-dc21c64232bd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:50.014380 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b8f0ffb7-ef5d-40b1-80fa-dc21c64232bd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:50.066536 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ab42408a-4430-4859-9a16-2355fd8cb8ec tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:50.074262 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ab42408a-4430-4859-9a16-2355fd8cb8ec tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:50.075884 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ab42408a-4430-4859-9a16-2355fd8cb8ec tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:50.077236 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ab42408a-4430-4859-9a16-2355fd8cb8ec tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1731 microversion: 2.20 time: 0.168460 Dec 20 09:39:50.077808 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 702/1438] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:49 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:50.147475 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b8f0ffb7-ef5d-40b1-80fa-dc21c64232bd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:50.155326 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b8f0ffb7-ef5d-40b1-80fa-dc21c64232bd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1672 microversion: 2.1 time: 0.153414 Dec 20 09:39:50.155931 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 737/1439] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:50 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:39:50.346883 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-cf0e07de-7185-4a5d-845b-6268b1b85da5 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:50.347416 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-cf0e07de-7185-4a5d-845b-6268b1b85da5 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:50.353264 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cf0e07de-7185-4a5d-845b-6268b1b85da5 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:50.353709 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cf0e07de-7185-4a5d-845b-6268b1b85da5 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:50.354474 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cf0e07de-7185-4a5d-845b-6268b1b85da5 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:50.354908 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cf0e07de-7185-4a5d-845b-6268b1b85da5 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:50.489338 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-cf0e07de-7185-4a5d-845b-6268b1b85da5 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:50.497390 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-cf0e07de-7185-4a5d-845b-6268b1b85da5 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1569 microversion: 2.1 time: 0.154224 Dec 20 09:39:50.497964 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 703/1440] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:50 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:51.094224 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c5ccb5ec-e441-41cb-92a5-4a1863e15e46 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:51.094925 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c5ccb5ec-e441-41cb-92a5-4a1863e15e46 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:51.101349 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c5ccb5ec-e441-41cb-92a5-4a1863e15e46 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:51.101869 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c5ccb5ec-e441-41cb-92a5-4a1863e15e46 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:51.102653 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c5ccb5ec-e441-41cb-92a5-4a1863e15e46 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:51.103096 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c5ccb5ec-e441-41cb-92a5-4a1863e15e46 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:51.172108 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8cd9bb63-a2f0-4ce0-813d-f03842c8717b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:51.172947 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8cd9bb63-a2f0-4ce0-813d-f03842c8717b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:51.179813 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8cd9bb63-a2f0-4ce0-813d-f03842c8717b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:51.180262 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8cd9bb63-a2f0-4ce0-813d-f03842c8717b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:51.181047 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8cd9bb63-a2f0-4ce0-813d-f03842c8717b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:51.181477 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8cd9bb63-a2f0-4ce0-813d-f03842c8717b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:51.262295 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-c5ccb5ec-e441-41cb-92a5-4a1863e15e46 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:51.270690 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-c5ccb5ec-e441-41cb-92a5-4a1863e15e46 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:51.272315 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-c5ccb5ec-e441-41cb-92a5-4a1863e15e46 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:51.274559 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c5ccb5ec-e441-41cb-92a5-4a1863e15e46 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1731 microversion: 2.20 time: 0.183879 Dec 20 09:39:51.275591 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 738/1441] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:51 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:51.346943 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8cd9bb63-a2f0-4ce0-813d-f03842c8717b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:51.359756 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8cd9bb63-a2f0-4ce0-813d-f03842c8717b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1672 microversion: 2.1 time: 0.191176 Dec 20 09:39:51.360351 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 704/1442] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:51 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1672 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:39:51.513537 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-82528c98-c9e4-4eef-b217-94521be5ab0f tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:51.514149 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-82528c98-c9e4-4eef-b217-94521be5ab0f tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:51.519963 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-82528c98-c9e4-4eef-b217-94521be5ab0f tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:51.520413 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-82528c98-c9e4-4eef-b217-94521be5ab0f tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:51.521244 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-82528c98-c9e4-4eef-b217-94521be5ab0f tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:51.521629 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-82528c98-c9e4-4eef-b217-94521be5ab0f tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:51.651545 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-82528c98-c9e4-4eef-b217-94521be5ab0f tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:51.659419 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-82528c98-c9e4-4eef-b217-94521be5ab0f tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1569 microversion: 2.1 time: 0.149573 Dec 20 09:39:51.660027 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 739/1443] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:51 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:52.293012 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6544671e-ff4d-4172-b509-554387c23a97 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:52.294174 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6544671e-ff4d-4172-b509-554387c23a97 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:52.300602 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6544671e-ff4d-4172-b509-554387c23a97 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:52.301043 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6544671e-ff4d-4172-b509-554387c23a97 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:52.301842 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6544671e-ff4d-4172-b509-554387c23a97 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:52.302243 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6544671e-ff4d-4172-b509-554387c23a97 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:52.378679 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4ab67458-0383-44c2-abeb-80b049954543 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:52.379455 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-4ab67458-0383-44c2-abeb-80b049954543 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:52.386841 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4ab67458-0383-44c2-abeb-80b049954543 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:52.387318 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4ab67458-0383-44c2-abeb-80b049954543 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:52.388158 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4ab67458-0383-44c2-abeb-80b049954543 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:52.388594 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-4ab67458-0383-44c2-abeb-80b049954543 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:52.449431 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6544671e-ff4d-4172-b509-554387c23a97 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:52.457179 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6544671e-ff4d-4172-b509-554387c23a97 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:52.458664 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6544671e-ff4d-4172-b509-554387c23a97 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:52.459858 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6544671e-ff4d-4172-b509-554387c23a97 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1731 microversion: 2.20 time: 0.170650 Dec 20 09:39:52.461132 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 705/1444] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:52 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:52.534438 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-4ab67458-0383-44c2-abeb-80b049954543 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:52.541761 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-4ab67458-0383-44c2-abeb-80b049954543 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1672 microversion: 2.1 time: 0.166876 Dec 20 09:39:52.542335 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 740/1445] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:52 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:39:52.683263 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1616ff18-2f88-40d6-b944-edfdd727d617 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:52.684596 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1616ff18-2f88-40d6-b944-edfdd727d617 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:52.693077 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1616ff18-2f88-40d6-b944-edfdd727d617 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:52.693806 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1616ff18-2f88-40d6-b944-edfdd727d617 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:52.694853 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1616ff18-2f88-40d6-b944-edfdd727d617 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:52.696043 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1616ff18-2f88-40d6-b944-edfdd727d617 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:53.007732 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1616ff18-2f88-40d6-b944-edfdd727d617 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:53.007732 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1616ff18-2f88-40d6-b944-edfdd727d617 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1569 microversion: 2.1 time: 0.196455 Dec 20 09:39:53.007732 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 706/1446] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:52 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:39:53.478759 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f2cb91dd-c4b3-48f6-9ab1-cd2480553f9f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:53.479383 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f2cb91dd-c4b3-48f6-9ab1-cd2480553f9f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:53.486408 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f2cb91dd-c4b3-48f6-9ab1-cd2480553f9f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:53.486858 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f2cb91dd-c4b3-48f6-9ab1-cd2480553f9f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:53.487920 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f2cb91dd-c4b3-48f6-9ab1-cd2480553f9f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:53.488358 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f2cb91dd-c4b3-48f6-9ab1-cd2480553f9f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:53.559028 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9654c920-3a1c-4a4c-99be-b364a0517a39 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:53.559639 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9654c920-3a1c-4a4c-99be-b364a0517a39 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:53.567059 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9654c920-3a1c-4a4c-99be-b364a0517a39 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:53.567502 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9654c920-3a1c-4a4c-99be-b364a0517a39 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:53.568311 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9654c920-3a1c-4a4c-99be-b364a0517a39 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:53.568738 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9654c920-3a1c-4a4c-99be-b364a0517a39 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:53.645853 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f2cb91dd-c4b3-48f6-9ab1-cd2480553f9f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:53.655777 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f2cb91dd-c4b3-48f6-9ab1-cd2480553f9f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:53.657424 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f2cb91dd-c4b3-48f6-9ab1-cd2480553f9f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:53.658577 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f2cb91dd-c4b3-48f6-9ab1-cd2480553f9f tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1731 microversion: 2.20 time: 0.183669 Dec 20 09:39:53.659138 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 741/1447] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:53 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:53.720011 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-9654c920-3a1c-4a4c-99be-b364a0517a39 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:53.755527 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9654c920-3a1c-4a4c-99be-b364a0517a39 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1672 microversion: 2.1 time: 0.172859 Dec 20 09:39:53.755527 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 707/1448] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:53 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1672 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:39:54.022073 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-bf7e0e3b-98ae-49a4-ae63-8647210f2053 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:54.022689 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-bf7e0e3b-98ae-49a4-ae63-8647210f2053 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:54.029679 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bf7e0e3b-98ae-49a4-ae63-8647210f2053 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:54.030131 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bf7e0e3b-98ae-49a4-ae63-8647210f2053 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:54.031007 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bf7e0e3b-98ae-49a4-ae63-8647210f2053 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:54.031685 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bf7e0e3b-98ae-49a4-ae63-8647210f2053 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:54.084971 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-b675a147-dc9e-4138-a87c-66931fe6806c req-3113538d-e6ad-49e1-847a-38cbafea1b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1243c272-99f3-4606-9eb2-a4fe7cd30de7", "name": "network-vif-deleted", "tag": "1b76648a-4a62-41c9-a26e-314b3c466e02"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:39:54.087019 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:39:54.087019 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:39:54.095210 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-b675a147-dc9e-4138-a87c-66931fe6806c req-3113538d-e6ad-49e1-847a-38cbafea1b82 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:54.095944 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-b675a147-dc9e-4138-a87c-66931fe6806c req-3113538d-e6ad-49e1-847a-38cbafea1b82 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:54.118187 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-b675a147-dc9e-4138-a87c-66931fe6806c req-3113538d-e6ad-49e1-847a-38cbafea1b82 service nova] Creating event network-vif-deleted:1b76648a-4a62-41c9-a26e-314b3c466e02 for instance 1243c272-99f3-4606-9eb2-a4fe7cd30de7 on hv-cinder-81908 Dec 20 09:39:54.133982 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-b675a147-dc9e-4138-a87c-66931fe6806c req-3113538d-e6ad-49e1-847a-38cbafea1b82 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124065 Dec 20 09:39:54.134722 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 742/1449] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:39:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:39:54.228811 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-bf7e0e3b-98ae-49a4-ae63-8647210f2053 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:54.238118 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-bf7e0e3b-98ae-49a4-ae63-8647210f2053 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1569 microversion: 2.1 time: 0.219717 Dec 20 09:39:54.239075 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 708/1450] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:54 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:39:54.677192 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-2be1301f-9a25-446c-be70-88d4c6d288cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:54.678013 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-2be1301f-9a25-446c-be70-88d4c6d288cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:54.684452 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2be1301f-9a25-446c-be70-88d4c6d288cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:54.692634 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2be1301f-9a25-446c-be70-88d4c6d288cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:54.692634 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2be1301f-9a25-446c-be70-88d4c6d288cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:54.692634 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2be1301f-9a25-446c-be70-88d4c6d288cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:54.750448 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1bf8b661-73d7-44e7-8cba-333e161bb846 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:54.751072 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1bf8b661-73d7-44e7-8cba-333e161bb846 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:54.758259 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1bf8b661-73d7-44e7-8cba-333e161bb846 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:54.758961 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1bf8b661-73d7-44e7-8cba-333e161bb846 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:54.760251 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1bf8b661-73d7-44e7-8cba-333e161bb846 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:54.760699 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1bf8b661-73d7-44e7-8cba-333e161bb846 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:54.810533 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1bf8b661-73d7-44e7-8cba-333e161bb846 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:54.811230 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1bf8b661-73d7-44e7-8cba-333e161bb846 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:54.811743 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.objects.instance [None req-1bf8b661-73d7-44e7-8cba-333e161bb846 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lazy-loading 'fault' on Instance uuid 1243c272-99f3-4606-9eb2-a4fe7cd30de7 {{(pid=116675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:39:54.846040 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-2be1301f-9a25-446c-be70-88d4c6d288cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:54.857396 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-2be1301f-9a25-446c-be70-88d4c6d288cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:54.858910 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-2be1301f-9a25-446c-be70-88d4c6d288cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:54.860126 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-2be1301f-9a25-446c-be70-88d4c6d288cf tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1731 microversion: 2.20 time: 0.187506 Dec 20 09:39:54.860859 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 743/1451] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:54 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:39:54.864343 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1bf8b661-73d7-44e7-8cba-333e161bb846 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:54.871920 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1bf8b661-73d7-44e7-8cba-333e161bb846 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 200 len: 1327 microversion: 2.1 time: 0.125734 Dec 20 09:39:54.872476 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 709/1452] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:54 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 1327 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:39:55.255632 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-13163b87-3f9a-4850-bd25-ecf955683ff2 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:55.256271 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-13163b87-3f9a-4850-bd25-ecf955683ff2 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:55.262914 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-13163b87-3f9a-4850-bd25-ecf955683ff2 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:55.263362 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-13163b87-3f9a-4850-bd25-ecf955683ff2 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:55.264363 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-13163b87-3f9a-4850-bd25-ecf955683ff2 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:55.264801 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-13163b87-3f9a-4850-bd25-ecf955683ff2 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:55.395442 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-13163b87-3f9a-4850-bd25-ecf955683ff2 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:55.402758 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-13163b87-3f9a-4850-bd25-ecf955683ff2 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1510 microversion: 2.1 time: 0.150906 Dec 20 09:39:55.403337 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 744/1453] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:55 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:55.418581 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-43d660ba-f261-4532-a8f9-42f6b6384df6 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:39:55.419147 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-43d660ba-f261-4532-a8f9-42f6b6384df6 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:55.425076 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-43d660ba-f261-4532-a8f9-42f6b6384df6 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:55.425528 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-43d660ba-f261-4532-a8f9-42f6b6384df6 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:55.426294 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-43d660ba-f261-4532-a8f9-42f6b6384df6 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:55.426730 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-43d660ba-f261-4532-a8f9-42f6b6384df6 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:55.705728 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: ERROR oslo.messaging._drivers.impl_rabbit [None req-43d660ba-f261-4532-a8f9-42f6b6384df6 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [4f13399f-34be-49c2-9ba2-00afa9d42b20] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 20 09:39:55.878179 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7158c475-e06d-4895-84b5-5d6c30426e02 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:55.878697 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7158c475-e06d-4895-84b5-5d6c30426e02 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:55.885074 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7158c475-e06d-4895-84b5-5d6c30426e02 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:55.885516 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7158c475-e06d-4895-84b5-5d6c30426e02 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:55.886289 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7158c475-e06d-4895-84b5-5d6c30426e02 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:55.886719 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7158c475-e06d-4895-84b5-5d6c30426e02 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:56.015452 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7158c475-e06d-4895-84b5-5d6c30426e02 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:56.023052 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7158c475-e06d-4895-84b5-5d6c30426e02 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:56.024543 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7158c475-e06d-4895-84b5-5d6c30426e02 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:56.025676 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7158c475-e06d-4895-84b5-5d6c30426e02 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1731 microversion: 2.20 time: 0.151284 Dec 20 09:39:56.026239 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 745/1454] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:55 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:39:56.030378 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-457a1599-4f64-4b7b-a95f-bffa26bbd8ca tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:56.031015 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-457a1599-4f64-4b7b-a95f-bffa26bbd8ca tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:56.036402 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-457a1599-4f64-4b7b-a95f-bffa26bbd8ca tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:56.036846 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-457a1599-4f64-4b7b-a95f-bffa26bbd8ca tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:56.037608 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-457a1599-4f64-4b7b-a95f-bffa26bbd8ca tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:56.038042 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-457a1599-4f64-4b7b-a95f-bffa26bbd8ca tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:56.051065 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.wsgi [None req-457a1599-4f64-4b7b-a95f-bffa26bbd8ca tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] HTTP exception thrown: Instance 1243c272-99f3-4606-9eb2-a4fe7cd30de7 could not be found. Dec 20 09:39:56.051634 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-457a1599-4f64-4b7b-a95f-bffa26bbd8ca tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Returning 404 to user: Instance 1243c272-99f3-4606-9eb2-a4fe7cd30de7 could not be found. {{(pid=116674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:39:56.052446 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-457a1599-4f64-4b7b-a95f-bffa26bbd8ca tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 404 len: 111 microversion: 2.1 time: 0.025330 Dec 20 09:39:56.052959 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 746/1455] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:56 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:39:56.061097 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-fef955ec-69e4-4013-8670-c95dc4f5f5ba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '.version_select at 0x7f914e38a940>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:56.064280 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fef955ec-69e4-4013-8670-c95dc4f5f5ba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [e7b09ccc-7ab8-4505-89f4-28e399646a42] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 20 09:39:56.712532 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO oslo.messaging._drivers.impl_rabbit [None req-43d660ba-f261-4532-a8f9-42f6b6384df6 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [4f13399f-34be-49c2-9ba2-00afa9d42b20] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 38592. Dec 20 09:39:56.716563 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-43d660ba-f261-4532-a8f9-42f6b6384df6 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "POST /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c/action" status: 202 len: 0 microversion: 2.1 time: 1.301771 Dec 20 09:39:56.717203 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 710/1456] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:39:55 2021] POST /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c/action => generated 0 bytes in 1303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:39:56.724711 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9f4b2503-24f8-4125-b9ef-1af5ef983d7d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:56.725302 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9f4b2503-24f8-4125-b9ef-1af5ef983d7d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:56.731877 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9f4b2503-24f8-4125-b9ef-1af5ef983d7d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:56.732328 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9f4b2503-24f8-4125-b9ef-1af5ef983d7d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:56.733110 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9f4b2503-24f8-4125-b9ef-1af5ef983d7d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:56.733546 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9f4b2503-24f8-4125-b9ef-1af5ef983d7d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:56.896738 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-9f4b2503-24f8-4125-b9ef-1af5ef983d7d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:56.907883 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9f4b2503-24f8-4125-b9ef-1af5ef983d7d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1518 microversion: 2.1 time: 0.182908 Dec 20 09:39:56.907883 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 711/1457] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:56 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:39:57.043980 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b794a749-7172-4a7d-9a8c-69b6d68d4d5e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:57.044589 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b794a749-7172-4a7d-9a8c-69b6d68d4d5e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:57.050310 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b794a749-7172-4a7d-9a8c-69b6d68d4d5e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:57.050758 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b794a749-7172-4a7d-9a8c-69b6d68d4d5e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:57.051535 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b794a749-7172-4a7d-9a8c-69b6d68d4d5e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:57.051992 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b794a749-7172-4a7d-9a8c-69b6d68d4d5e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:57.073202 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO oslo.messaging._drivers.impl_rabbit [None req-fef955ec-69e4-4013-8670-c95dc4f5f5ba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [e7b09ccc-7ab8-4505-89f4-28e399646a42] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 38600. Dec 20 09:39:57.175214 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-fef955ec-69e4-4013-8670-c95dc4f5f5ba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-773355402" status: 202 len: 0 microversion: 2.1 time: 1.117819 Dec 20 09:39:57.175849 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 747/1458] 10.222.0.62 () {58 vars in 1217 bytes} [Mon Dec 20 09:39:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-773355402 => generated 0 bytes in 1119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 20 09:39:57.180523 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-ee0f684b-2e5f-4d2b-87ca-7151419f14b8 req-e10cb5d6-5c2d-467d-910f-6cee5a4cedf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9faf5b6c-7f96-4a91-b944-fd72f5665f64", "name": "network-vif-plugged", "status": "completed", "tag": "4fac1673-dd2f-4368-bfcc-be873f33a32b"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:39:57.182136 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:39:57.182136 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:39:57.189835 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-ee0f684b-2e5f-4d2b-87ca-7151419f14b8 req-e10cb5d6-5c2d-467d-910f-6cee5a4cedf5 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:57.190286 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-ee0f684b-2e5f-4d2b-87ca-7151419f14b8 req-e10cb5d6-5c2d-467d-910f-6cee5a4cedf5 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:57.191322 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b794a749-7172-4a7d-9a8c-69b6d68d4d5e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:57.200485 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b794a749-7172-4a7d-9a8c-69b6d68d4d5e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:57.207908 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b794a749-7172-4a7d-9a8c-69b6d68d4d5e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:57.207908 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b794a749-7172-4a7d-9a8c-69b6d68d4d5e tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1731 microversion: 2.20 time: 0.163689 Dec 20 09:39:57.207908 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 712/1459] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:57 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:39:57.211272 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-ee0f684b-2e5f-4d2b-87ca-7151419f14b8 req-e10cb5d6-5c2d-467d-910f-6cee5a4cedf5 service nova] Creating event network-vif-plugged:4fac1673-dd2f-4368-bfcc-be873f33a32b for instance 9faf5b6c-7f96-4a91-b944-fd72f5665f64 on hv-cinder-81908 Dec 20 09:39:57.217825 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-ee0f684b-2e5f-4d2b-87ca-7151419f14b8 req-e10cb5d6-5c2d-467d-910f-6cee5a4cedf5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040801 Dec 20 09:39:57.218494 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 748/1460] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:39:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:39:57.920936 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a5ba4258-193a-43a4-83c9-df52dad7694d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:57.921575 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a5ba4258-193a-43a4-83c9-df52dad7694d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:57.930373 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a5ba4258-193a-43a4-83c9-df52dad7694d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:57.930829 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a5ba4258-193a-43a4-83c9-df52dad7694d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:57.931627 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a5ba4258-193a-43a4-83c9-df52dad7694d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:57.932086 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a5ba4258-193a-43a4-83c9-df52dad7694d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:58.026758 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-28dc30d0-90f6-4e9d-b7ac-a88ede7b1f36 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'create', calling method: .version_select at 0x7f914e513e50>, body: {"keypair": {"name": "tempest-keypair-2064850814"}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:39:58.040989 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-28dc30d0-90f6-4e9d-b7ac-a88ede7b1f36 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Getting quotas for project d5a528a79d2c4c94bd7b4a0b200b21f7. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:39:58.045333 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-28dc30d0-90f6-4e9d-b7ac-a88ede7b1f36 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Getting quotas for user 52d81af5e27f434dba28295236ca39d0 and project d5a528a79d2c4c94bd7b4a0b200b21f7. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:39:58.075424 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a5ba4258-193a-43a4-83c9-df52dad7694d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:58.082765 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a5ba4258-193a-43a4-83c9-df52dad7694d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1518 microversion: 2.1 time: 0.165514 Dec 20 09:39:58.083369 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 713/1461] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:57 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:58.224766 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ea11f049-70f7-4c36-94af-2cc35cbdf74c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:58.231993 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ea11f049-70f7-4c36-94af-2cc35cbdf74c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:58.231993 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ea11f049-70f7-4c36-94af-2cc35cbdf74c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:58.231993 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ea11f049-70f7-4c36-94af-2cc35cbdf74c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:58.232530 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ea11f049-70f7-4c36-94af-2cc35cbdf74c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:58.232965 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ea11f049-70f7-4c36-94af-2cc35cbdf74c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:58.286483 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-28dc30d0-90f6-4e9d-b7ac-a88ede7b1f36 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Getting quotas for project d5a528a79d2c4c94bd7b4a0b200b21f7. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:39:58.290346 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-28dc30d0-90f6-4e9d-b7ac-a88ede7b1f36 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Getting quotas for user 52d81af5e27f434dba28295236ca39d0 and project d5a528a79d2c4c94bd7b4a0b200b21f7. Resources: {'key_pairs'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:39:58.303962 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-28dc30d0-90f6-4e9d-b7ac-a88ede7b1f36 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.281750 Dec 20 09:39:58.304769 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 749/1462] 10.222.0.62 () {60 vars in 1157 bytes} [Mon Dec 20 09:39:58 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:39:58.363820 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ea11f049-70f7-4c36-94af-2cc35cbdf74c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:58.372002 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ea11f049-70f7-4c36-94af-2cc35cbdf74c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:58.373497 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ea11f049-70f7-4c36-94af-2cc35cbdf74c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:58.374636 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ea11f049-70f7-4c36-94af-2cc35cbdf74c tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1731 microversion: 2.20 time: 0.154456 Dec 20 09:39:58.375193 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 714/1463] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:58 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:39:59.100512 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c98212c0-ae35-4efa-953e-7b32cb597e94 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:59.101427 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c98212c0-ae35-4efa-953e-7b32cb597e94 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:59.111695 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c98212c0-ae35-4efa-953e-7b32cb597e94 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:59.111695 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c98212c0-ae35-4efa-953e-7b32cb597e94 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:59.111695 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c98212c0-ae35-4efa-953e-7b32cb597e94 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:59.111695 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c98212c0-ae35-4efa-953e-7b32cb597e94 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:59.237583 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-dd8ebc35-abe4-4965-a51a-5c45e88e6daa req-e34cda5c-9f2c-49f0-a73b-388c5e94172d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2454a5d-038c-422c-8b61-b88674e18a3c", "name": "network-vif-unplugged", "status": "completed", "tag": "4bfd2d96-5b20-4456-afea-5b3bbf0b1cfe"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:39:59.239305 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:39:59.239305 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:39:59.249489 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-dd8ebc35-abe4-4965-a51a-5c45e88e6daa req-e34cda5c-9f2c-49f0-a73b-388c5e94172d service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:59.249489 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-dd8ebc35-abe4-4965-a51a-5c45e88e6daa req-e34cda5c-9f2c-49f0-a73b-388c5e94172d service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:59.261299 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.compute.server_external_events [req-dd8ebc35-abe4-4965-a51a-5c45e88e6daa req-e34cda5c-9f2c-49f0-a73b-388c5e94172d service nova] Unable to find a host for instance b2454a5d-038c-422c-8b61-b88674e18a3c. Dropping event network-vif-unplugged {{(pid=116675) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 20 09:39:59.262444 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-dd8ebc35-abe4-4965-a51a-5c45e88e6daa req-e34cda5c-9f2c-49f0-a73b-388c5e94172d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028841 Dec 20 09:39:59.263569 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 715/1464] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:39:59 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 20 09:39:59.269157 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-c98212c0-ae35-4efa-953e-7b32cb597e94 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:59.284201 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c98212c0-ae35-4efa-953e-7b32cb597e94 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1518 microversion: 2.1 time: 0.187631 Dec 20 09:39:59.285048 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 750/1465] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:39:59 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1518 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:39:59.392847 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-701f726b-31b7-4be3-89fc-f61dba05ce13 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:39:59.393453 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-701f726b-31b7-4be3-89fc-f61dba05ce13 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:39:59.399508 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-701f726b-31b7-4be3-89fc-f61dba05ce13 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:59.400125 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-701f726b-31b7-4be3-89fc-f61dba05ce13 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:59.402587 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-701f726b-31b7-4be3-89fc-f61dba05ce13 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:39:59.402587 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-701f726b-31b7-4be3-89fc-f61dba05ce13 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:39:59.592661 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-701f726b-31b7-4be3-89fc-f61dba05ce13 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:59.604368 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-701f726b-31b7-4be3-89fc-f61dba05ce13 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:59.604368 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-701f726b-31b7-4be3-89fc-f61dba05ce13 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:39:59.604368 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-701f726b-31b7-4be3-89fc-f61dba05ce13 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1731 microversion: 2.20 time: 0.214197 Dec 20 09:39:59.604766 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 716/1466] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:39:59 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1731 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:40:00.301836 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-aebdadb2-fe9e-4a1d-adbf-611f6fbed98d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:00.302489 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-aebdadb2-fe9e-4a1d-adbf-611f6fbed98d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:00.308921 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-aebdadb2-fe9e-4a1d-adbf-611f6fbed98d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:00.309389 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-aebdadb2-fe9e-4a1d-adbf-611f6fbed98d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:00.310157 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-aebdadb2-fe9e-4a1d-adbf-611f6fbed98d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:00.310598 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-aebdadb2-fe9e-4a1d-adbf-611f6fbed98d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:00.485978 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-aebdadb2-fe9e-4a1d-adbf-611f6fbed98d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:00.493755 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-aebdadb2-fe9e-4a1d-adbf-611f6fbed98d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1518 microversion: 2.1 time: 0.195694 Dec 20 09:40:00.494332 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 751/1467] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:00 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1518 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:00.586236 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0fcf59b4-fad3-4904-b5fc-c4e3a2a24dee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1975836528", "imageRef": "6f828f0b-c445-46a5-9960-492746785ef3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85d805f9-8f65-44aa-8b19-1203a8239e20"}], "security_groups": [{"name": "tempest-securitygroup--1766186849"}], "key_name": "tempest-keypair-2064850814", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:00.622890 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a3459cb9-d6c6-4d90-b562-8ef892a558f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:00.623370 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a3459cb9-d6c6-4d90-b562-8ef892a558f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:00.629212 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a3459cb9-d6c6-4d90-b562-8ef892a558f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:00.629615 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a3459cb9-d6c6-4d90-b562-8ef892a558f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:00.630454 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a3459cb9-d6c6-4d90-b562-8ef892a558f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:00.630843 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a3459cb9-d6c6-4d90-b562-8ef892a558f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:00.710013 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.network.neutron [None req-0fcf59b4-fad3-4904-b5fc-c4e3a2a24dee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] validate_networks() for [('85d805f9-8f65-44aa-8b19-1203a8239e20', None, None, None, None, None)] {{(pid=116675) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 09:40:00.851019 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a3459cb9-d6c6-4d90-b562-8ef892a558f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:00.858684 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a3459cb9-d6c6-4d90-b562-8ef892a558f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:00.860193 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a3459cb9-d6c6-4d90-b562-8ef892a558f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:00.864288 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a3459cb9-d6c6-4d90-b562-8ef892a558f8 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1718 microversion: 2.20 time: 0.242979 Dec 20 09:40:00.864288 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 752/1468] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:40:00 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1718 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 20 09:40:01.127083 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-0fcf59b4-fad3-4904-b5fc-c4e3a2a24dee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Flavor limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 09:40:01.127631 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-0fcf59b4-fad3-4904-b5fc-c4e3a2a24dee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Image limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 09:40:01.128148 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-0fcf59b4-fad3-4904-b5fc-c4e3a2a24dee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Flavor pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 09:40:01.128563 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-0fcf59b4-fad3-4904-b5fc-c4e3a2a24dee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Image pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 09:40:01.128979 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-0fcf59b4-fad3-4904-b5fc-c4e3a2a24dee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 09:40:01.137551 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0fcf59b4-fad3-4904-b5fc-c4e3a2a24dee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:01.138014 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0fcf59b4-fad3-4904-b5fc-c4e3a2a24dee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:01.138833 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0fcf59b4-fad3-4904-b5fc-c4e3a2a24dee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:01.139273 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0fcf59b4-fad3-4904-b5fc-c4e3a2a24dee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:01.155202 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-0fcf59b4-fad3-4904-b5fc-c4e3a2a24dee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Getting quotas for project d5a528a79d2c4c94bd7b4a0b200b21f7. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:40:01.159115 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-0fcf59b4-fad3-4904-b5fc-c4e3a2a24dee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Getting quotas for user 52d81af5e27f434dba28295236ca39d0 and project d5a528a79d2c4c94bd7b4a0b200b21f7. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:40:01.170266 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0fcf59b4-fad3-4904-b5fc-c4e3a2a24dee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Going to run 1 instances... {{(pid=116675) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 09:40:01.172607 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0fcf59b4-fad3-4904-b5fc-c4e3a2a24dee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f828f0b-c445-46a5-9960-492746785ef3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 09:40:01.289644 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0fcf59b4-fad3-4904-b5fc-c4e3a2a24dee tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.707211 Dec 20 09:40:01.290197 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 717/1469] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 20 09:40:00 2021] POST /compute/v2.1/servers => generated 402 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 09:40:01.301039 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5acc7e63-06f3-418d-914e-019058ba539d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:01.302133 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-5acc7e63-06f3-418d-914e-019058ba539d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:01.362942 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-5acc7e63-06f3-418d-914e-019058ba539d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:01.370177 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-5acc7e63-06f3-418d-914e-019058ba539d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36" status: 200 len: 1238 microversion: 2.1 time: 0.073478 Dec 20 09:40:01.370742 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 753/1470] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:01 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36 => generated 1238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:01.510355 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1d511aab-89d8-4501-8e50-6a7101ab54bf tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:01.510968 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1d511aab-89d8-4501-8e50-6a7101ab54bf tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:01.516917 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1d511aab-89d8-4501-8e50-6a7101ab54bf tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:01.517366 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1d511aab-89d8-4501-8e50-6a7101ab54bf tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:01.518152 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1d511aab-89d8-4501-8e50-6a7101ab54bf tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:01.518589 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1d511aab-89d8-4501-8e50-6a7101ab54bf tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:01.658514 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-1d511aab-89d8-4501-8e50-6a7101ab54bf tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:01.666516 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1d511aab-89d8-4501-8e50-6a7101ab54bf tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1518 microversion: 2.1 time: 0.160010 Dec 20 09:40:01.667085 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 718/1471] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:01 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:02.386433 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f9105911-462d-4d84-8f13-2139c0a7621a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:02.387042 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f9105911-462d-4d84-8f13-2139c0a7621a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:02.394470 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f9105911-462d-4d84-8f13-2139c0a7621a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:02.394923 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f9105911-462d-4d84-8f13-2139c0a7621a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:02.400841 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f9105911-462d-4d84-8f13-2139c0a7621a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:02.400841 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f9105911-462d-4d84-8f13-2139c0a7621a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:02.456381 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f9105911-462d-4d84-8f13-2139c0a7621a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:02.463774 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f9105911-462d-4d84-8f13-2139c0a7621a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36" status: 200 len: 1234 microversion: 2.1 time: 0.081164 Dec 20 09:40:02.464452 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 754/1472] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:02 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36 => generated 1234 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:02.684212 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-de423bf4-9dfb-420d-a6a3-f3fe5722c8b5 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:02.684845 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-de423bf4-9dfb-420d-a6a3-f3fe5722c8b5 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:02.691274 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-de423bf4-9dfb-420d-a6a3-f3fe5722c8b5 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:02.691650 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-de423bf4-9dfb-420d-a6a3-f3fe5722c8b5 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:02.692452 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-de423bf4-9dfb-420d-a6a3-f3fe5722c8b5 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:02.692879 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-de423bf4-9dfb-420d-a6a3-f3fe5722c8b5 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:02.830718 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-de423bf4-9dfb-420d-a6a3-f3fe5722c8b5 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:02.839673 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-de423bf4-9dfb-420d-a6a3-f3fe5722c8b5 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1520 microversion: 2.1 time: 0.159056 Dec 20 09:40:02.841224 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 719/1473] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:02 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:03.482879 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e184a895-e3c1-4d98-8f82-a1fff0749f10 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:03.483491 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e184a895-e3c1-4d98-8f82-a1fff0749f10 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:03.490086 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e184a895-e3c1-4d98-8f82-a1fff0749f10 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:03.490536 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e184a895-e3c1-4d98-8f82-a1fff0749f10 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:03.491333 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e184a895-e3c1-4d98-8f82-a1fff0749f10 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:03.491806 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e184a895-e3c1-4d98-8f82-a1fff0749f10 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:03.553501 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e184a895-e3c1-4d98-8f82-a1fff0749f10 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:03.561684 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e184a895-e3c1-4d98-8f82-a1fff0749f10 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36" status: 200 len: 1296 microversion: 2.1 time: 0.083184 Dec 20 09:40:03.562268 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 755/1474] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:03 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36 => generated 1296 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:03.860728 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-671fc01f-d1f2-4cd0-8a99-b0653608e774 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:03.861328 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-671fc01f-d1f2-4cd0-8a99-b0653608e774 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:03.867789 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-671fc01f-d1f2-4cd0-8a99-b0653608e774 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:03.868232 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-671fc01f-d1f2-4cd0-8a99-b0653608e774 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:03.869085 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-671fc01f-d1f2-4cd0-8a99-b0653608e774 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:03.869776 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-671fc01f-d1f2-4cd0-8a99-b0653608e774 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:04.018884 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-671fc01f-d1f2-4cd0-8a99-b0653608e774 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:04.027031 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-671fc01f-d1f2-4cd0-8a99-b0653608e774 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1576 microversion: 2.1 time: 0.170540 Dec 20 09:40:04.027938 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 720/1475] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:03 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:04.582013 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1d745fd2-00e1-4464-9881-65ed67efda8a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:04.582756 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-1d745fd2-00e1-4464-9881-65ed67efda8a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:04.589065 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1d745fd2-00e1-4464-9881-65ed67efda8a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:04.589519 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1d745fd2-00e1-4464-9881-65ed67efda8a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:04.590304 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1d745fd2-00e1-4464-9881-65ed67efda8a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:04.590744 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1d745fd2-00e1-4464-9881-65ed67efda8a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:04.733778 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1d745fd2-00e1-4464-9881-65ed67efda8a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:04.741506 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1d745fd2-00e1-4464-9881-65ed67efda8a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36" status: 200 len: 1364 microversion: 2.1 time: 0.163155 Dec 20 09:40:04.742104 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 756/1476] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:04 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:04.928204 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-dc09a9ff-95c6-4718-9aa1-23e7da33e8c5 req-1ed3847d-3cbf-467f-8090-90a494650569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2f7f56f-8489-4589-a846-970440886b36", "tag": "feab4141-9fc1-4311-b05c-6745b26afc52"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:04.929649 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:40:04.929649 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:40:04.944260 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-dc09a9ff-95c6-4718-9aa1-23e7da33e8c5 req-1ed3847d-3cbf-467f-8090-90a494650569 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:04.949316 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-dc09a9ff-95c6-4718-9aa1-23e7da33e8c5 req-1ed3847d-3cbf-467f-8090-90a494650569 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:04.958113 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-dc09a9ff-95c6-4718-9aa1-23e7da33e8c5 req-1ed3847d-3cbf-467f-8090-90a494650569 service nova] Creating event network-changed:feab4141-9fc1-4311-b05c-6745b26afc52 for instance c2f7f56f-8489-4589-a846-970440886b36 on hv-cinder-81908 Dec 20 09:40:04.963057 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-dc09a9ff-95c6-4718-9aa1-23e7da33e8c5 req-1ed3847d-3cbf-467f-8090-90a494650569 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038964 Dec 20 09:40:04.963687 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 721/1477] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:40:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:40:05.045122 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e6fe536a-a852-4c64-a18d-a59b519316eb tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:05.045731 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e6fe536a-a852-4c64-a18d-a59b519316eb tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:05.052302 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e6fe536a-a852-4c64-a18d-a59b519316eb tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:05.052754 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e6fe536a-a852-4c64-a18d-a59b519316eb tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:05.053549 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e6fe536a-a852-4c64-a18d-a59b519316eb tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:05.053994 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e6fe536a-a852-4c64-a18d-a59b519316eb tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:05.193027 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e6fe536a-a852-4c64-a18d-a59b519316eb tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:05.200530 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e6fe536a-a852-4c64-a18d-a59b519316eb tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1576 microversion: 2.1 time: 0.159773 Dec 20 09:40:05.201130 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 757/1478] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:05 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:05.759265 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b83d3487-6f64-4342-a002-e74b8fd50ee4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:05.759941 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b83d3487-6f64-4342-a002-e74b8fd50ee4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:05.765922 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b83d3487-6f64-4342-a002-e74b8fd50ee4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:05.767392 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b83d3487-6f64-4342-a002-e74b8fd50ee4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:05.767392 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b83d3487-6f64-4342-a002-e74b8fd50ee4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:05.767583 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b83d3487-6f64-4342-a002-e74b8fd50ee4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:05.902039 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b83d3487-6f64-4342-a002-e74b8fd50ee4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:05.909947 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b83d3487-6f64-4342-a002-e74b8fd50ee4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36" status: 200 len: 1364 microversion: 2.1 time: 0.154749 Dec 20 09:40:05.910523 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 722/1479] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:05 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:06.217863 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-332da73f-6d00-47f3-ba2e-52d92992b7da tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:06.218465 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-332da73f-6d00-47f3-ba2e-52d92992b7da tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:06.225067 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-332da73f-6d00-47f3-ba2e-52d92992b7da tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:06.225512 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-332da73f-6d00-47f3-ba2e-52d92992b7da tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:06.226290 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-332da73f-6d00-47f3-ba2e-52d92992b7da tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:06.226821 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-332da73f-6d00-47f3-ba2e-52d92992b7da tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:06.365015 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-332da73f-6d00-47f3-ba2e-52d92992b7da tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:06.372365 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-332da73f-6d00-47f3-ba2e-52d92992b7da tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1576 microversion: 2.1 time: 0.158927 Dec 20 09:40:06.372878 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 758/1480] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:06 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:06.926989 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f7af5b7b-a3bb-4da0-ad7c-273689372e85 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:06.927580 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f7af5b7b-a3bb-4da0-ad7c-273689372e85 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:06.933851 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f7af5b7b-a3bb-4da0-ad7c-273689372e85 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:06.934300 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f7af5b7b-a3bb-4da0-ad7c-273689372e85 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:06.935105 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f7af5b7b-a3bb-4da0-ad7c-273689372e85 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:06.935573 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f7af5b7b-a3bb-4da0-ad7c-273689372e85 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:07.062500 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f7af5b7b-a3bb-4da0-ad7c-273689372e85 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:07.069622 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f7af5b7b-a3bb-4da0-ad7c-273689372e85 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36" status: 200 len: 1364 microversion: 2.1 time: 0.146325 Dec 20 09:40:07.070197 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 723/1481] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:06 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:07.389659 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1516a0a5-3c98-4343-bf58-3618154b9745 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:07.390308 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-1516a0a5-3c98-4343-bf58-3618154b9745 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:07.396540 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1516a0a5-3c98-4343-bf58-3618154b9745 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:07.396985 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1516a0a5-3c98-4343-bf58-3618154b9745 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:07.397762 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1516a0a5-3c98-4343-bf58-3618154b9745 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:07.398199 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1516a0a5-3c98-4343-bf58-3618154b9745 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:07.532832 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1516a0a5-3c98-4343-bf58-3618154b9745 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:07.540239 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1516a0a5-3c98-4343-bf58-3618154b9745 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1576 microversion: 2.1 time: 0.154887 Dec 20 09:40:07.540813 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 759/1482] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:07 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:08.086220 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-cb555b0d-1702-4715-a7bb-90d9fb38fe22 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:08.086825 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-cb555b0d-1702-4715-a7bb-90d9fb38fe22 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:08.093503 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cb555b0d-1702-4715-a7bb-90d9fb38fe22 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:08.093965 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cb555b0d-1702-4715-a7bb-90d9fb38fe22 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:08.094711 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cb555b0d-1702-4715-a7bb-90d9fb38fe22 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:08.095147 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cb555b0d-1702-4715-a7bb-90d9fb38fe22 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:08.219381 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-cb555b0d-1702-4715-a7bb-90d9fb38fe22 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:08.226427 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-cb555b0d-1702-4715-a7bb-90d9fb38fe22 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36" status: 200 len: 1364 microversion: 2.1 time: 0.143863 Dec 20 09:40:08.226990 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 724/1483] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:08 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36 => generated 1364 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:08.556958 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e9c4703a-b468-4f13-b7e0-34cc01fc321c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:08.557565 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e9c4703a-b468-4f13-b7e0-34cc01fc321c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:08.564684 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e9c4703a-b468-4f13-b7e0-34cc01fc321c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:08.565131 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e9c4703a-b468-4f13-b7e0-34cc01fc321c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:08.565915 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e9c4703a-b468-4f13-b7e0-34cc01fc321c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:08.566352 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e9c4703a-b468-4f13-b7e0-34cc01fc321c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:08.696365 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e9c4703a-b468-4f13-b7e0-34cc01fc321c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:08.704015 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e9c4703a-b468-4f13-b7e0-34cc01fc321c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1576 microversion: 2.1 time: 0.150702 Dec 20 09:40:08.704588 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 760/1484] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:08 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:40:09.243138 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-26705959-d269-486a-b9a6-7d60292571db tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:09.243795 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-26705959-d269-486a-b9a6-7d60292571db tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:09.249597 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-26705959-d269-486a-b9a6-7d60292571db tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:09.252472 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-26705959-d269-486a-b9a6-7d60292571db tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:09.252472 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-26705959-d269-486a-b9a6-7d60292571db tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:09.252472 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-26705959-d269-486a-b9a6-7d60292571db tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:09.380540 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-26705959-d269-486a-b9a6-7d60292571db tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:09.387782 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-26705959-d269-486a-b9a6-7d60292571db tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36" status: 200 len: 1364 microversion: 2.1 time: 0.148499 Dec 20 09:40:09.388359 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 725/1485] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:09 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:09.721066 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a5349841-1933-42c3-a0fb-5e19b52b4a3c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:09.724245 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a5349841-1933-42c3-a0fb-5e19b52b4a3c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:09.727813 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a5349841-1933-42c3-a0fb-5e19b52b4a3c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:09.728268 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a5349841-1933-42c3-a0fb-5e19b52b4a3c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:09.729048 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a5349841-1933-42c3-a0fb-5e19b52b4a3c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:09.729481 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a5349841-1933-42c3-a0fb-5e19b52b4a3c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:09.857837 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a5349841-1933-42c3-a0fb-5e19b52b4a3c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:09.866050 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a5349841-1933-42c3-a0fb-5e19b52b4a3c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1576 microversion: 2.1 time: 0.149181 Dec 20 09:40:09.866569 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 761/1486] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:09 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:10.404526 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-092a4c4b-593e-4993-aa23-09f0d67b12e5 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:10.405659 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-092a4c4b-593e-4993-aa23-09f0d67b12e5 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:10.412047 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-092a4c4b-593e-4993-aa23-09f0d67b12e5 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:10.412493 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-092a4c4b-593e-4993-aa23-09f0d67b12e5 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:10.413274 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-092a4c4b-593e-4993-aa23-09f0d67b12e5 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:10.413704 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-092a4c4b-593e-4993-aa23-09f0d67b12e5 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:10.544952 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-092a4c4b-593e-4993-aa23-09f0d67b12e5 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:10.552727 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-092a4c4b-593e-4993-aa23-09f0d67b12e5 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36" status: 200 len: 1364 microversion: 2.1 time: 0.151917 Dec 20 09:40:10.553295 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 726/1487] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:10 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:10.882331 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-56ea6515-ac73-4bcb-8791-eef31dffe51e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:10.882943 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-56ea6515-ac73-4bcb-8791-eef31dffe51e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:10.889283 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-56ea6515-ac73-4bcb-8791-eef31dffe51e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:10.889731 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-56ea6515-ac73-4bcb-8791-eef31dffe51e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:10.890517 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-56ea6515-ac73-4bcb-8791-eef31dffe51e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:10.890950 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-56ea6515-ac73-4bcb-8791-eef31dffe51e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:11.018111 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-56ea6515-ac73-4bcb-8791-eef31dffe51e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:11.025363 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-56ea6515-ac73-4bcb-8791-eef31dffe51e tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1576 microversion: 2.1 time: 0.146767 Dec 20 09:40:11.025936 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 762/1488] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:10 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:11.313913 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-bb2422df-4dfc-4aad-9a68-9df3b26bb073 req-07f931b7-139b-4a64-96b2-9cae3f9f62c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2f7f56f-8489-4589-a846-970440886b36", "name": "network-vif-plugged", "status": "completed", "tag": "feab4141-9fc1-4311-b05c-6745b26afc52"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:11.315446 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:40:11.315446 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:40:11.322163 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-bb2422df-4dfc-4aad-9a68-9df3b26bb073 req-07f931b7-139b-4a64-96b2-9cae3f9f62c5 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:11.322611 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-bb2422df-4dfc-4aad-9a68-9df3b26bb073 req-07f931b7-139b-4a64-96b2-9cae3f9f62c5 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:11.333316 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-bb2422df-4dfc-4aad-9a68-9df3b26bb073 req-07f931b7-139b-4a64-96b2-9cae3f9f62c5 service nova] Creating event network-vif-plugged:feab4141-9fc1-4311-b05c-6745b26afc52 for instance c2f7f56f-8489-4589-a846-970440886b36 on hv-cinder-81908 Dec 20 09:40:11.338388 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-bb2422df-4dfc-4aad-9a68-9df3b26bb073 req-07f931b7-139b-4a64-96b2-9cae3f9f62c5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028125 Dec 20 09:40:11.341462 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 727/1489] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:40:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:40:11.568417 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-03ccd387-391c-4c7b-ae03-6781b10fca1a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:11.569033 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-03ccd387-391c-4c7b-ae03-6781b10fca1a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:11.575080 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-03ccd387-391c-4c7b-ae03-6781b10fca1a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:11.575526 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-03ccd387-391c-4c7b-ae03-6781b10fca1a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:11.576343 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-03ccd387-391c-4c7b-ae03-6781b10fca1a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:11.576783 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-03ccd387-391c-4c7b-ae03-6781b10fca1a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:11.712123 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-03ccd387-391c-4c7b-ae03-6781b10fca1a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:11.717294 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-03ccd387-391c-4c7b-ae03-6781b10fca1a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36" status: 200 len: 1364 microversion: 2.1 time: 0.152642 Dec 20 09:40:11.717896 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 763/1490] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:11 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:12.043602 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-bfab1379-ce31-4ecb-ae47-ebe7d42ac87d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:12.044317 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-bfab1379-ce31-4ecb-ae47-ebe7d42ac87d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:12.050900 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bfab1379-ce31-4ecb-ae47-ebe7d42ac87d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:12.051368 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bfab1379-ce31-4ecb-ae47-ebe7d42ac87d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:12.052168 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bfab1379-ce31-4ecb-ae47-ebe7d42ac87d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:12.052601 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bfab1379-ce31-4ecb-ae47-ebe7d42ac87d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:12.180601 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-bfab1379-ce31-4ecb-ae47-ebe7d42ac87d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:12.187747 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-bfab1379-ce31-4ecb-ae47-ebe7d42ac87d tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1576 microversion: 2.1 time: 0.148547 Dec 20 09:40:12.188308 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 728/1491] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:12 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:12.734300 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f520c299-ac28-4bc9-bdda-5e8ffc427868 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:12.734913 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f520c299-ac28-4bc9-bdda-5e8ffc427868 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:12.741537 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f520c299-ac28-4bc9-bdda-5e8ffc427868 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:12.742059 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f520c299-ac28-4bc9-bdda-5e8ffc427868 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:12.743104 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f520c299-ac28-4bc9-bdda-5e8ffc427868 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:12.743546 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f520c299-ac28-4bc9-bdda-5e8ffc427868 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:12.877483 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f520c299-ac28-4bc9-bdda-5e8ffc427868 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:12.885136 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f520c299-ac28-4bc9-bdda-5e8ffc427868 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36" status: 200 len: 1364 microversion: 2.1 time: 0.155067 Dec 20 09:40:12.885709 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 764/1492] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:12 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:13.204850 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-54f83d41-8e02-47e8-8508-8863c7bc5e9c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:13.205643 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-54f83d41-8e02-47e8-8508-8863c7bc5e9c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:13.212378 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-54f83d41-8e02-47e8-8508-8863c7bc5e9c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:13.212829 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-54f83d41-8e02-47e8-8508-8863c7bc5e9c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:13.213708 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-54f83d41-8e02-47e8-8508-8863c7bc5e9c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:13.214150 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-54f83d41-8e02-47e8-8508-8863c7bc5e9c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:13.352422 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-54f83d41-8e02-47e8-8508-8863c7bc5e9c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:13.360091 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-54f83d41-8e02-47e8-8508-8863c7bc5e9c tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1576 microversion: 2.1 time: 0.159522 Dec 20 09:40:13.360652 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 729/1493] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:13 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:13.901962 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a7b75d09-8c1b-4a05-b60f-16c3d15c9e73 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:13.902571 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a7b75d09-8c1b-4a05-b60f-16c3d15c9e73 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:13.909478 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a7b75d09-8c1b-4a05-b60f-16c3d15c9e73 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:13.909917 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a7b75d09-8c1b-4a05-b60f-16c3d15c9e73 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:13.910690 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a7b75d09-8c1b-4a05-b60f-16c3d15c9e73 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:13.911123 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a7b75d09-8c1b-4a05-b60f-16c3d15c9e73 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:14.038246 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-a7b75d09-8c1b-4a05-b60f-16c3d15c9e73 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:14.045656 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a7b75d09-8c1b-4a05-b60f-16c3d15c9e73 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36" status: 200 len: 1550 microversion: 2.1 time: 0.147311 Dec 20 09:40:14.046240 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 765/1494] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:13 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36 => generated 1550 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:14.062095 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1fbc6acb-050c-41f1-9831-0dd0e8798ea5 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:14.062597 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1fbc6acb-050c-41f1-9831-0dd0e8798ea5 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:14.068355 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1fbc6acb-050c-41f1-9831-0dd0e8798ea5 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:14.068811 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1fbc6acb-050c-41f1-9831-0dd0e8798ea5 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:14.069597 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1fbc6acb-050c-41f1-9831-0dd0e8798ea5 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:14.070041 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1fbc6acb-050c-41f1-9831-0dd0e8798ea5 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:14.153256 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1fbc6acb-050c-41f1-9831-0dd0e8798ea5 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095406 Dec 20 09:40:14.153861 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 730/1495] 10.222.0.62 () {58 vars in 1274 bytes} [Mon Dec 20 09:40:14 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:40:14.377666 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ac20fb56-2dfd-4682-8e61-eb20abc6267a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:14.378312 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ac20fb56-2dfd-4682-8e61-eb20abc6267a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:14.384452 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac20fb56-2dfd-4682-8e61-eb20abc6267a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:14.384900 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac20fb56-2dfd-4682-8e61-eb20abc6267a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:14.385691 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac20fb56-2dfd-4682-8e61-eb20abc6267a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:14.386123 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ac20fb56-2dfd-4682-8e61-eb20abc6267a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:14.689840 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ac20fb56-2dfd-4682-8e61-eb20abc6267a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:14.697163 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ac20fb56-2dfd-4682-8e61-eb20abc6267a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1576 microversion: 2.1 time: 0.323746 Dec 20 09:40:14.697738 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 766/1496] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:14 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1576 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:15.270049 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-26f8d327-50af-4a48-a968-89ccf739b025 req-7ddb29f2-8044-4124-ab4c-dfc9d757bcb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2454a5d-038c-422c-8b61-b88674e18a3c", "name": "network-vif-plugged", "status": "completed", "tag": "4bfd2d96-5b20-4456-afea-5b3bbf0b1cfe"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:15.271743 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:40:15.271743 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:40:15.278981 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-26f8d327-50af-4a48-a968-89ccf739b025 req-7ddb29f2-8044-4124-ab4c-dfc9d757bcb6 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:15.279567 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-26f8d327-50af-4a48-a968-89ccf739b025 req-7ddb29f2-8044-4124-ab4c-dfc9d757bcb6 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:15.290633 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-26f8d327-50af-4a48-a968-89ccf739b025 req-7ddb29f2-8044-4124-ab4c-dfc9d757bcb6 service nova] Creating event network-vif-plugged:4bfd2d96-5b20-4456-afea-5b3bbf0b1cfe for instance b2454a5d-038c-422c-8b61-b88674e18a3c on hv-cinder-81908 Dec 20 09:40:15.295385 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-26f8d327-50af-4a48-a968-89ccf739b025 req-7ddb29f2-8044-4124-ab4c-dfc9d757bcb6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030302 Dec 20 09:40:15.296555 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 731/1497] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:40:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:40:15.442754 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b6b86136-0490-4599-9639-c36cc4f03b84 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:15.443795 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b6b86136-0490-4599-9639-c36cc4f03b84 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:15.451586 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b6b86136-0490-4599-9639-c36cc4f03b84 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:15.452067 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b6b86136-0490-4599-9639-c36cc4f03b84 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:15.453025 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b6b86136-0490-4599-9639-c36cc4f03b84 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:15.453473 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b6b86136-0490-4599-9639-c36cc4f03b84 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:15.511106 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-aed0d6c5-9acb-4bce-8a36-3345f625c9c7 req-e026cf15-c00e-4f74-8314-5db1c660213e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2f7f56f-8489-4589-a846-970440886b36", "tag": "feab4141-9fc1-4311-b05c-6745b26afc52"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:15.512817 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:40:15.512817 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:40:15.520397 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-aed0d6c5-9acb-4bce-8a36-3345f625c9c7 req-e026cf15-c00e-4f74-8314-5db1c660213e service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:15.520936 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-aed0d6c5-9acb-4bce-8a36-3345f625c9c7 req-e026cf15-c00e-4f74-8314-5db1c660213e service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:15.521296 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b6b86136-0490-4599-9639-c36cc4f03b84 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 14 microversion: 2.1 time: 0.083043 Dec 20 09:40:15.524583 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 767/1498] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:15 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 20 09:40:15.532988 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-aed0d6c5-9acb-4bce-8a36-3345f625c9c7 req-e026cf15-c00e-4f74-8314-5db1c660213e service nova] Creating event network-changed:feab4141-9fc1-4311-b05c-6745b26afc52 for instance c2f7f56f-8489-4589-a846-970440886b36 on hv-cinder-81908 Dec 20 09:40:15.537905 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-aed0d6c5-9acb-4bce-8a36-3345f625c9c7 req-e026cf15-c00e-4f74-8314-5db1c660213e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093591 Dec 20 09:40:15.539272 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 732/1499] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:40:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:40:15.715893 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-14593d8f-2242-42b1-9784-ce621313b25a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:15.716597 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-14593d8f-2242-42b1-9784-ce621313b25a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:15.724726 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-14593d8f-2242-42b1-9784-ce621313b25a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:15.725196 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-14593d8f-2242-42b1-9784-ce621313b25a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:15.726045 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-14593d8f-2242-42b1-9784-ce621313b25a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:15.726487 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-14593d8f-2242-42b1-9784-ce621313b25a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:15.861128 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-14593d8f-2242-42b1-9784-ce621313b25a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:15.868683 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-14593d8f-2242-42b1-9784-ce621313b25a tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1576 microversion: 2.1 time: 0.157307 Dec 20 09:40:15.869252 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 768/1500] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:15 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:16.533651 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-64b93db9-3569-4933-afd6-b5f2bdee6f3c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:16.534644 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-64b93db9-3569-4933-afd6-b5f2bdee6f3c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:16.541531 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-64b93db9-3569-4933-afd6-b5f2bdee6f3c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:16.542025 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-64b93db9-3569-4933-afd6-b5f2bdee6f3c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:16.542754 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-64b93db9-3569-4933-afd6-b5f2bdee6f3c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:16.543193 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-64b93db9-3569-4933-afd6-b5f2bdee6f3c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:16.602223 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-64b93db9-3569-4933-afd6-b5f2bdee6f3c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 14 microversion: 2.1 time: 0.073209 Dec 20 09:40:16.603096 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 733/1501] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:16 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 09:40:16.885357 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1bab4521-72f4-4585-9099-dcbbe35d014b tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:16.885904 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-1bab4521-72f4-4585-9099-dcbbe35d014b tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:16.892874 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1bab4521-72f4-4585-9099-dcbbe35d014b tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:16.893168 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1bab4521-72f4-4585-9099-dcbbe35d014b tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:16.893956 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1bab4521-72f4-4585-9099-dcbbe35d014b tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:16.895149 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1bab4521-72f4-4585-9099-dcbbe35d014b tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:17.029841 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1bab4521-72f4-4585-9099-dcbbe35d014b tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:17.038105 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1bab4521-72f4-4585-9099-dcbbe35d014b tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1576 microversion: 2.1 time: 0.156415 Dec 20 09:40:17.038689 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 769/1502] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:16 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:17.613201 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-315a6ef9-6fa5-4851-8588-e20df40691de tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:17.614196 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-315a6ef9-6fa5-4851-8588-e20df40691de tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:17.621052 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-315a6ef9-6fa5-4851-8588-e20df40691de tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:17.621501 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-315a6ef9-6fa5-4851-8588-e20df40691de tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:17.622268 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-315a6ef9-6fa5-4851-8588-e20df40691de tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:17.622697 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-315a6ef9-6fa5-4851-8588-e20df40691de tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:17.679727 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-315a6ef9-6fa5-4851-8588-e20df40691de tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 14 microversion: 2.1 time: 0.070624 Dec 20 09:40:17.680327 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 734/1503] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:17 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 09:40:18.054769 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b985fd12-50ff-41dc-80fa-c663e0818415 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:18.055329 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b985fd12-50ff-41dc-80fa-c663e0818415 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:18.061651 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b985fd12-50ff-41dc-80fa-c663e0818415 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:18.062100 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b985fd12-50ff-41dc-80fa-c663e0818415 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:18.062884 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b985fd12-50ff-41dc-80fa-c663e0818415 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:18.063321 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b985fd12-50ff-41dc-80fa-c663e0818415 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:18.193343 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b985fd12-50ff-41dc-80fa-c663e0818415 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:18.200602 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b985fd12-50ff-41dc-80fa-c663e0818415 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1563 microversion: 2.1 time: 0.149638 Dec 20 09:40:18.201163 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 770/1504] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:40:18 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:18.691478 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-43a214e3-907f-41f7-8bca-336fa921c1fe tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:18.692425 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-43a214e3-907f-41f7-8bca-336fa921c1fe tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:18.699206 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-43a214e3-907f-41f7-8bca-336fa921c1fe tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:18.699650 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-43a214e3-907f-41f7-8bca-336fa921c1fe tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:18.700433 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-43a214e3-907f-41f7-8bca-336fa921c1fe tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:18.700863 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-43a214e3-907f-41f7-8bca-336fa921c1fe tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:18.760059 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-43a214e3-907f-41f7-8bca-336fa921c1fe tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 14 microversion: 2.1 time: 0.073130 Dec 20 09:40:18.760650 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 735/1505] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:18 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 09:40:19.771448 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8863a02c-1998-409c-8dd4-7aceacb20992 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:19.772303 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-8863a02c-1998-409c-8dd4-7aceacb20992 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:19.778526 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8863a02c-1998-409c-8dd4-7aceacb20992 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:19.778972 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8863a02c-1998-409c-8dd4-7aceacb20992 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:19.779802 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8863a02c-1998-409c-8dd4-7aceacb20992 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:19.780237 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8863a02c-1998-409c-8dd4-7aceacb20992 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:19.835458 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8863a02c-1998-409c-8dd4-7aceacb20992 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 14 microversion: 2.1 time: 0.067752 Dec 20 09:40:19.836079 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 771/1506] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:19 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 09:40:20.847416 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d25b9a18-1976-4d13-858f-359169e9722a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:20.848523 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d25b9a18-1976-4d13-858f-359169e9722a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:20.855303 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d25b9a18-1976-4d13-858f-359169e9722a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:20.860361 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d25b9a18-1976-4d13-858f-359169e9722a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:20.860361 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d25b9a18-1976-4d13-858f-359169e9722a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:20.860361 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d25b9a18-1976-4d13-858f-359169e9722a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:20.923687 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d25b9a18-1976-4d13-858f-359169e9722a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 14 microversion: 2.1 time: 0.080729 Dec 20 09:40:20.924343 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 736/1507] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:20 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 20 09:40:21.934798 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-98f60175-672f-4377-85be-af94542a663d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:21.935823 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-98f60175-672f-4377-85be-af94542a663d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:21.943105 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-98f60175-672f-4377-85be-af94542a663d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:21.943538 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-98f60175-672f-4377-85be-af94542a663d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:21.944325 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-98f60175-672f-4377-85be-af94542a663d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:21.944753 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-98f60175-672f-4377-85be-af94542a663d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:22.005954 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-98f60175-672f-4377-85be-af94542a663d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 14 microversion: 2.1 time: 0.075031 Dec 20 09:40:22.006557 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 772/1508] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:21 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 09:40:23.017755 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-3c4e25b6-6077-4e63-b271-cd550fd442bf tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:23.018746 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-3c4e25b6-6077-4e63-b271-cd550fd442bf tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:23.025532 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3c4e25b6-6077-4e63-b271-cd550fd442bf tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:23.025971 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3c4e25b6-6077-4e63-b271-cd550fd442bf tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:23.026730 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3c4e25b6-6077-4e63-b271-cd550fd442bf tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:23.027160 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-3c4e25b6-6077-4e63-b271-cd550fd442bf tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:23.091629 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-3c4e25b6-6077-4e63-b271-cd550fd442bf tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 14 microversion: 2.1 time: 0.078364 Dec 20 09:40:23.092308 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 737/1509] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:23 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 09:40:24.103452 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-651837bc-ede7-4fc9-94e4-7411cf9d291b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:24.104585 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-651837bc-ede7-4fc9-94e4-7411cf9d291b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:24.111653 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-651837bc-ede7-4fc9-94e4-7411cf9d291b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:24.112111 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-651837bc-ede7-4fc9-94e4-7411cf9d291b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:24.112879 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-651837bc-ede7-4fc9-94e4-7411cf9d291b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:24.113307 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-651837bc-ede7-4fc9-94e4-7411cf9d291b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:24.170767 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-651837bc-ede7-4fc9-94e4-7411cf9d291b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 14 microversion: 2.1 time: 0.071239 Dec 20 09:40:24.171360 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 773/1510] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:24 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 09:40:25.182051 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-df5cb0c7-1f52-4633-b81d-1a52d6e39363 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:25.183053 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-df5cb0c7-1f52-4633-b81d-1a52d6e39363 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:25.189825 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-df5cb0c7-1f52-4633-b81d-1a52d6e39363 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:25.190269 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-df5cb0c7-1f52-4633-b81d-1a52d6e39363 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:25.191039 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-df5cb0c7-1f52-4633-b81d-1a52d6e39363 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:25.191472 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-df5cb0c7-1f52-4633-b81d-1a52d6e39363 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:25.250766 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-df5cb0c7-1f52-4633-b81d-1a52d6e39363 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 14 microversion: 2.1 time: 0.072611 Dec 20 09:40:25.251698 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 738/1511] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:25 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 20 09:40:26.261879 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f0ace4a0-3789-44ae-b52c-68e954699cd6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:26.262867 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f0ace4a0-3789-44ae-b52c-68e954699cd6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:26.269628 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f0ace4a0-3789-44ae-b52c-68e954699cd6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:26.270068 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f0ace4a0-3789-44ae-b52c-68e954699cd6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:26.270836 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f0ace4a0-3789-44ae-b52c-68e954699cd6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:26.271259 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f0ace4a0-3789-44ae-b52c-68e954699cd6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:26.343627 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f0ace4a0-3789-44ae-b52c-68e954699cd6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 3649 microversion: 2.1 time: 0.085580 Dec 20 09:40:26.345371 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 774/1512] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:26 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 3649 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:27.354744 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-01a98ff1-be17-4f62-8404-804d472851c0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:27.355785 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-01a98ff1-be17-4f62-8404-804d472851c0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:27.362824 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-01a98ff1-be17-4f62-8404-804d472851c0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:27.370197 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-01a98ff1-be17-4f62-8404-804d472851c0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:27.370197 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-01a98ff1-be17-4f62-8404-804d472851c0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:27.370197 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-01a98ff1-be17-4f62-8404-804d472851c0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:27.444607 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-01a98ff1-be17-4f62-8404-804d472851c0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 13153 microversion: 2.1 time: 0.093714 Dec 20 09:40:27.445249 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 739/1513] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:27 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 13153 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:28.457488 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-19c23bd6-6f0b-4e0f-9d53-330638e91260 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:28.458012 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-19c23bd6-6f0b-4e0f-9d53-330638e91260 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:28.464580 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-19c23bd6-6f0b-4e0f-9d53-330638e91260 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:28.465028 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-19c23bd6-6f0b-4e0f-9d53-330638e91260 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:28.465806 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-19c23bd6-6f0b-4e0f-9d53-330638e91260 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:28.466243 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-19c23bd6-6f0b-4e0f-9d53-330638e91260 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:28.548620 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-19c23bd6-6f0b-4e0f-9d53-330638e91260 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 18449 microversion: 2.1 time: 0.096350 Dec 20 09:40:28.549279 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 775/1514] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:28 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 18449 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:29.559864 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f6843778-8fa0-4998-b8b3-e74bd266fb58 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:29.560866 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f6843778-8fa0-4998-b8b3-e74bd266fb58 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:29.567633 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f6843778-8fa0-4998-b8b3-e74bd266fb58 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:29.568111 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f6843778-8fa0-4998-b8b3-e74bd266fb58 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:29.568892 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f6843778-8fa0-4998-b8b3-e74bd266fb58 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:29.569351 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f6843778-8fa0-4998-b8b3-e74bd266fb58 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:29.637941 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f6843778-8fa0-4998-b8b3-e74bd266fb58 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 19342 microversion: 2.1 time: 0.082029 Dec 20 09:40:29.638552 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 740/1515] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:29 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 19342 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:30.650013 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9f6a64d5-b773-43dd-a20e-3031887d7104 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:30.650935 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9f6a64d5-b773-43dd-a20e-3031887d7104 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:30.657838 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9f6a64d5-b773-43dd-a20e-3031887d7104 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:30.668544 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9f6a64d5-b773-43dd-a20e-3031887d7104 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:30.668544 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9f6a64d5-b773-43dd-a20e-3031887d7104 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:30.668544 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9f6a64d5-b773-43dd-a20e-3031887d7104 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:30.736661 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9f6a64d5-b773-43dd-a20e-3031887d7104 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 21935 microversion: 2.1 time: 0.090423 Dec 20 09:40:30.737369 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 776/1516] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:30 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 21935 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:31.748435 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-349b1cc6-3e91-44d3-b6bb-33bce7e50cc1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:31.749326 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-349b1cc6-3e91-44d3-b6bb-33bce7e50cc1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:31.756492 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-349b1cc6-3e91-44d3-b6bb-33bce7e50cc1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:31.765242 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-349b1cc6-3e91-44d3-b6bb-33bce7e50cc1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:31.765242 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-349b1cc6-3e91-44d3-b6bb-33bce7e50cc1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:31.765242 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-349b1cc6-3e91-44d3-b6bb-33bce7e50cc1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:31.832961 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-349b1cc6-3e91-44d3-b6bb-33bce7e50cc1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 23235 microversion: 2.1 time: 0.088551 Dec 20 09:40:31.833919 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 741/1517] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:31 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 23235 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:32.845170 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-873e4d05-9fd6-400a-9417-b486b644cd1b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:32.846090 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-873e4d05-9fd6-400a-9417-b486b644cd1b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:32.852976 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-873e4d05-9fd6-400a-9417-b486b644cd1b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:32.853430 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-873e4d05-9fd6-400a-9417-b486b644cd1b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:32.854195 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-873e4d05-9fd6-400a-9417-b486b644cd1b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:32.854634 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-873e4d05-9fd6-400a-9417-b486b644cd1b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:32.936316 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-873e4d05-9fd6-400a-9417-b486b644cd1b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 24194 microversion: 2.1 time: 0.095057 Dec 20 09:40:32.937402 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 777/1518] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:32 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 24194 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:33.949839 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-fd5ab276-76cf-463a-a98d-b320016a0d96 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:33.950853 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-fd5ab276-76cf-463a-a98d-b320016a0d96 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:33.958339 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fd5ab276-76cf-463a-a98d-b320016a0d96 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:33.958789 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fd5ab276-76cf-463a-a98d-b320016a0d96 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:33.959563 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fd5ab276-76cf-463a-a98d-b320016a0d96 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:33.960027 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fd5ab276-76cf-463a-a98d-b320016a0d96 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:34.035340 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-fd5ab276-76cf-463a-a98d-b320016a0d96 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 25802 microversion: 2.1 time: 0.089397 Dec 20 09:40:34.036022 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 742/1519] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:33 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 25802 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:35.047184 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a6e07fdb-3bb0-4a84-b644-8a5b4d074122 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:35.048706 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a6e07fdb-3bb0-4a84-b644-8a5b4d074122 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:35.055616 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a6e07fdb-3bb0-4a84-b644-8a5b4d074122 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:35.056084 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a6e07fdb-3bb0-4a84-b644-8a5b4d074122 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:35.056850 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a6e07fdb-3bb0-4a84-b644-8a5b4d074122 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:35.057279 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a6e07fdb-3bb0-4a84-b644-8a5b4d074122 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:35.142829 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a6e07fdb-3bb0-4a84-b644-8a5b4d074122 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 26988 microversion: 2.1 time: 0.099510 Dec 20 09:40:35.143459 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 778/1520] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:35 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 26988 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:36.154874 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-aced4efa-f904-4d8b-a35e-f3bbf58feb87 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:36.155912 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-aced4efa-f904-4d8b-a35e-f3bbf58feb87 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:36.162784 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-aced4efa-f904-4d8b-a35e-f3bbf58feb87 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:36.163236 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-aced4efa-f904-4d8b-a35e-f3bbf58feb87 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:36.164054 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-aced4efa-f904-4d8b-a35e-f3bbf58feb87 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:36.164494 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-aced4efa-f904-4d8b-a35e-f3bbf58feb87 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:36.249784 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-aced4efa-f904-4d8b-a35e-f3bbf58feb87 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 27674 microversion: 2.1 time: 0.098866 Dec 20 09:40:36.250991 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 743/1521] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:36 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 27674 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:37.264246 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-17594eb3-48ee-4832-8100-0cb31ac69dd7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:37.265294 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-17594eb3-48ee-4832-8100-0cb31ac69dd7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:37.272804 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-17594eb3-48ee-4832-8100-0cb31ac69dd7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:37.273246 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-17594eb3-48ee-4832-8100-0cb31ac69dd7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:37.274150 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-17594eb3-48ee-4832-8100-0cb31ac69dd7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:37.274913 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-17594eb3-48ee-4832-8100-0cb31ac69dd7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:37.357370 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-17594eb3-48ee-4832-8100-0cb31ac69dd7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 27977 microversion: 2.1 time: 0.096955 Dec 20 09:40:37.358289 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 779/1522] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:37 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 27977 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:38.369677 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-44c73c35-297e-499f-a02c-5b1133422526 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:38.370683 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-44c73c35-297e-499f-a02c-5b1133422526 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:38.378169 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-44c73c35-297e-499f-a02c-5b1133422526 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:38.378620 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-44c73c35-297e-499f-a02c-5b1133422526 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:38.379396 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-44c73c35-297e-499f-a02c-5b1133422526 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:38.379871 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-44c73c35-297e-499f-a02c-5b1133422526 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:38.459298 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-44c73c35-297e-499f-a02c-5b1133422526 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28219 microversion: 2.1 time: 0.093451 Dec 20 09:40:38.460355 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 744/1523] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:38 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:39.471443 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-19423ec1-aaf0-4ca5-b7d4-08421ce8e13f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:39.472475 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-19423ec1-aaf0-4ca5-b7d4-08421ce8e13f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:39.479282 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-19423ec1-aaf0-4ca5-b7d4-08421ce8e13f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:39.479756 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-19423ec1-aaf0-4ca5-b7d4-08421ce8e13f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:39.480533 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-19423ec1-aaf0-4ca5-b7d4-08421ce8e13f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:39.480964 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-19423ec1-aaf0-4ca5-b7d4-08421ce8e13f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:39.541991 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-19423ec1-aaf0-4ca5-b7d4-08421ce8e13f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28219 microversion: 2.1 time: 0.074496 Dec 20 09:40:39.545236 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 780/1524] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:39 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:40.555609 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-cffe6478-64a5-4262-8677-b081cc768e8b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:40.556632 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-cffe6478-64a5-4262-8677-b081cc768e8b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:40.564146 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cffe6478-64a5-4262-8677-b081cc768e8b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:40.564597 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cffe6478-64a5-4262-8677-b081cc768e8b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:40.565373 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cffe6478-64a5-4262-8677-b081cc768e8b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:40.565812 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cffe6478-64a5-4262-8677-b081cc768e8b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:40.627721 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-cffe6478-64a5-4262-8677-b081cc768e8b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28219 microversion: 2.1 time: 0.077065 Dec 20 09:40:40.628593 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 745/1525] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:40 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:41.639636 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8b04b8cf-b0e4-48f8-b61a-b2e030439ca2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:41.640707 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-8b04b8cf-b0e4-48f8-b61a-b2e030439ca2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:41.648200 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8b04b8cf-b0e4-48f8-b61a-b2e030439ca2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:41.648640 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8b04b8cf-b0e4-48f8-b61a-b2e030439ca2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:41.649404 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8b04b8cf-b0e4-48f8-b61a-b2e030439ca2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:41.649838 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8b04b8cf-b0e4-48f8-b61a-b2e030439ca2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:41.709997 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8b04b8cf-b0e4-48f8-b61a-b2e030439ca2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28219 microversion: 2.1 time: 0.074159 Dec 20 09:40:41.711409 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 781/1526] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:41 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:42.722081 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c3aa56cd-714f-4f92-b2cd-8e30ddba15e6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:42.723000 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c3aa56cd-714f-4f92-b2cd-8e30ddba15e6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:42.729939 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c3aa56cd-714f-4f92-b2cd-8e30ddba15e6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:42.730385 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c3aa56cd-714f-4f92-b2cd-8e30ddba15e6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:42.731151 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c3aa56cd-714f-4f92-b2cd-8e30ddba15e6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:42.731585 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c3aa56cd-714f-4f92-b2cd-8e30ddba15e6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:42.795362 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c3aa56cd-714f-4f92-b2cd-8e30ddba15e6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28219 microversion: 2.1 time: 0.077926 Dec 20 09:40:42.796015 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 746/1527] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:42 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:43.807400 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9aec8f16-5893-4954-8b7a-58177e12b9a1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:43.808357 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9aec8f16-5893-4954-8b7a-58177e12b9a1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:43.815176 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9aec8f16-5893-4954-8b7a-58177e12b9a1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:43.815618 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9aec8f16-5893-4954-8b7a-58177e12b9a1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:43.816412 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9aec8f16-5893-4954-8b7a-58177e12b9a1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:43.816843 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9aec8f16-5893-4954-8b7a-58177e12b9a1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:43.876762 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9aec8f16-5893-4954-8b7a-58177e12b9a1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28219 microversion: 2.1 time: 0.073388 Dec 20 09:40:43.877439 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 782/1528] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:43 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:44.889163 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1dafb04f-9da0-49f9-b601-509b2081b14f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:44.890170 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1dafb04f-9da0-49f9-b601-509b2081b14f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:44.897569 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1dafb04f-9da0-49f9-b601-509b2081b14f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:44.898016 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1dafb04f-9da0-49f9-b601-509b2081b14f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:44.898786 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1dafb04f-9da0-49f9-b601-509b2081b14f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:44.899221 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1dafb04f-9da0-49f9-b601-509b2081b14f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:44.966950 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1dafb04f-9da0-49f9-b601-509b2081b14f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28219 microversion: 2.1 time: 0.081684 Dec 20 09:40:44.967750 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 747/1529] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:44 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:45.979424 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c3b1d6a2-7789-4239-a517-9ab235094920 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:45.980465 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c3b1d6a2-7789-4239-a517-9ab235094920 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:45.988011 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c3b1d6a2-7789-4239-a517-9ab235094920 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:45.988461 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c3b1d6a2-7789-4239-a517-9ab235094920 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:45.989240 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c3b1d6a2-7789-4239-a517-9ab235094920 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:45.989672 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c3b1d6a2-7789-4239-a517-9ab235094920 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:46.061503 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c3b1d6a2-7789-4239-a517-9ab235094920 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28219 microversion: 2.1 time: 0.085966 Dec 20 09:40:46.062126 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 783/1530] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:45 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:47.073522 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-cc766509-d35f-42e8-a732-0d8073f0dd9d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:47.074533 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-cc766509-d35f-42e8-a732-0d8073f0dd9d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:47.081954 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cc766509-d35f-42e8-a732-0d8073f0dd9d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:47.082405 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cc766509-d35f-42e8-a732-0d8073f0dd9d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:47.083181 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cc766509-d35f-42e8-a732-0d8073f0dd9d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:47.083623 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cc766509-d35f-42e8-a732-0d8073f0dd9d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:47.143894 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-cc766509-d35f-42e8-a732-0d8073f0dd9d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28219 microversion: 2.1 time: 0.074211 Dec 20 09:40:47.144588 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 748/1531] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:47 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:48.156497 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c6da81a0-03f7-452c-92bb-1d4621e33c6e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:48.157518 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c6da81a0-03f7-452c-92bb-1d4621e33c6e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:48.164384 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c6da81a0-03f7-452c-92bb-1d4621e33c6e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:48.164835 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c6da81a0-03f7-452c-92bb-1d4621e33c6e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:48.165647 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c6da81a0-03f7-452c-92bb-1d4621e33c6e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:48.166084 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c6da81a0-03f7-452c-92bb-1d4621e33c6e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:48.236324 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c6da81a0-03f7-452c-92bb-1d4621e33c6e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28219 microversion: 2.1 time: 0.083369 Dec 20 09:40:48.237246 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 784/1532] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:48 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:49.248583 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f8c01475-01fb-4437-9a51-938c534d6d76 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:49.249610 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f8c01475-01fb-4437-9a51-938c534d6d76 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:49.256558 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f8c01475-01fb-4437-9a51-938c534d6d76 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:49.257011 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f8c01475-01fb-4437-9a51-938c534d6d76 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:49.257792 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f8c01475-01fb-4437-9a51-938c534d6d76 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:49.258242 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f8c01475-01fb-4437-9a51-938c534d6d76 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:49.345220 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f8c01475-01fb-4437-9a51-938c534d6d76 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28219 microversion: 2.1 time: 0.099897 Dec 20 09:40:49.345889 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 749/1533] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:49 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:50.357435 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b6fd75c9-7a5d-4a15-a6c8-f43df49d12ce tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:50.358441 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b6fd75c9-7a5d-4a15-a6c8-f43df49d12ce tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:50.366233 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b6fd75c9-7a5d-4a15-a6c8-f43df49d12ce tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:50.366712 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b6fd75c9-7a5d-4a15-a6c8-f43df49d12ce tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:50.367490 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b6fd75c9-7a5d-4a15-a6c8-f43df49d12ce tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:50.367953 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b6fd75c9-7a5d-4a15-a6c8-f43df49d12ce tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:50.428093 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b6fd75c9-7a5d-4a15-a6c8-f43df49d12ce tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28219 microversion: 2.1 time: 0.074440 Dec 20 09:40:50.428958 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 785/1534] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:50 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:51.440615 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-83317df9-163d-409d-a69e-6147b0378eec tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:51.441605 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-83317df9-163d-409d-a69e-6147b0378eec tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:51.448508 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-83317df9-163d-409d-a69e-6147b0378eec tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:51.448894 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-83317df9-163d-409d-a69e-6147b0378eec tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:51.449663 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-83317df9-163d-409d-a69e-6147b0378eec tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:51.450096 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-83317df9-163d-409d-a69e-6147b0378eec tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:51.511534 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-83317df9-163d-409d-a69e-6147b0378eec tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28219 microversion: 2.1 time: 0.075350 Dec 20 09:40:51.512460 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 750/1535] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:51 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:52.523589 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-eb55d899-73ab-42df-966a-1984ab216275 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:52.524541 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-eb55d899-73ab-42df-966a-1984ab216275 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:52.531340 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-eb55d899-73ab-42df-966a-1984ab216275 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:52.531844 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-eb55d899-73ab-42df-966a-1984ab216275 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:52.532611 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-eb55d899-73ab-42df-966a-1984ab216275 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:52.533040 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-eb55d899-73ab-42df-966a-1984ab216275 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:52.593568 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-eb55d899-73ab-42df-966a-1984ab216275 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28219 microversion: 2.1 time: 0.073983 Dec 20 09:40:52.594192 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 786/1536] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:52 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:53.607914 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-dce7101f-de45-4cac-ba76-697df47c1010 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:53.608932 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-dce7101f-de45-4cac-ba76-697df47c1010 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:53.618455 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-dce7101f-de45-4cac-ba76-697df47c1010 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:53.618907 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-dce7101f-de45-4cac-ba76-697df47c1010 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:53.619713 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-dce7101f-de45-4cac-ba76-697df47c1010 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:53.620153 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-dce7101f-de45-4cac-ba76-697df47c1010 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:53.703697 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-dce7101f-de45-4cac-ba76-697df47c1010 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28510 microversion: 2.1 time: 0.100540 Dec 20 09:40:53.704632 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 751/1537] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:53 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28510 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:54.715989 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-08fcfcff-45e1-47e6-ba63-7e045a4cd126 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:54.716912 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-08fcfcff-45e1-47e6-ba63-7e045a4cd126 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:54.723810 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-08fcfcff-45e1-47e6-ba63-7e045a4cd126 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:54.724264 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-08fcfcff-45e1-47e6-ba63-7e045a4cd126 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:54.725042 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-08fcfcff-45e1-47e6-ba63-7e045a4cd126 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:54.725481 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-08fcfcff-45e1-47e6-ba63-7e045a4cd126 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:54.788176 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-08fcfcff-45e1-47e6-ba63-7e045a4cd126 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28510 microversion: 2.1 time: 0.076177 Dec 20 09:40:54.788950 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 787/1538] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:54 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28510 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:55.799312 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0d6be90c-c89c-43e9-bcc6-91436ce94009 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:55.800287 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0d6be90c-c89c-43e9-bcc6-91436ce94009 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:55.807173 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0d6be90c-c89c-43e9-bcc6-91436ce94009 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:55.807623 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0d6be90c-c89c-43e9-bcc6-91436ce94009 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:55.808444 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0d6be90c-c89c-43e9-bcc6-91436ce94009 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:55.808881 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0d6be90c-c89c-43e9-bcc6-91436ce94009 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:55.888848 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0d6be90c-c89c-43e9-bcc6-91436ce94009 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.093500 Dec 20 09:40:55.889772 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 752/1539] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:55 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 09:40:56.881940 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-13bd3a26-e945-4f6b-97d7-df53dfd80f6d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:56.883019 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-13bd3a26-e945-4f6b-97d7-df53dfd80f6d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:56.890353 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-13bd3a26-e945-4f6b-97d7-df53dfd80f6d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:56.890804 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-13bd3a26-e945-4f6b-97d7-df53dfd80f6d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:56.891587 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-13bd3a26-e945-4f6b-97d7-df53dfd80f6d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:56.892050 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-13bd3a26-e945-4f6b-97d7-df53dfd80f6d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:56.901655 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c4e66cc5-fdf7-480c-8e27-37d8eab16477 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:56.902657 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c4e66cc5-fdf7-480c-8e27-37d8eab16477 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:56.910524 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c4e66cc5-fdf7-480c-8e27-37d8eab16477 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:56.910949 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c4e66cc5-fdf7-480c-8e27-37d8eab16477 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:56.911764 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c4e66cc5-fdf7-480c-8e27-37d8eab16477 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:56.912200 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c4e66cc5-fdf7-480c-8e27-37d8eab16477 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:56.923110 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-13bd3a26-e945-4f6b-97d7-df53dfd80f6d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045316 Dec 20 09:40:56.927860 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 788/1540] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Dec 20 09:40:56 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:40:56.976355 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c4e66cc5-fdf7-480c-8e27-37d8eab16477 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.078477 Dec 20 09:40:56.980231 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 753/1541] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:56 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 09:40:56.980376 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-cabf5992-7838-4de3-9832-2b8be4481bcc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:56.980376 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-cabf5992-7838-4de3-9832-2b8be4481bcc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:56.984601 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cabf5992-7838-4de3-9832-2b8be4481bcc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:56.985053 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cabf5992-7838-4de3-9832-2b8be4481bcc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:56.986135 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cabf5992-7838-4de3-9832-2b8be4481bcc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:56.986569 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cabf5992-7838-4de3-9832-2b8be4481bcc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:57.012124 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-cabf5992-7838-4de3-9832-2b8be4481bcc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Going to try to terminate instance {{(pid=116674) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 09:40:57.292279 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-cabf5992-7838-4de3-9832-2b8be4481bcc tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 204 len: 0 microversion: 2.20 time: 0.317735 Dec 20 09:40:57.292878 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 789/1542] 10.222.0.62 () {60 vars in 1279 bytes} [Mon Dec 20 09:40:56 2021] DELETE /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 20 09:40:57.301411 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a499d584-78de-497a-945c-350fb27058be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:57.303523 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a499d584-78de-497a-945c-350fb27058be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:57.309068 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a499d584-78de-497a-945c-350fb27058be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:57.309519 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a499d584-78de-497a-945c-350fb27058be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:57.310301 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a499d584-78de-497a-945c-350fb27058be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:57.310740 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a499d584-78de-497a-945c-350fb27058be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:57.445042 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a499d584-78de-497a-945c-350fb27058be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:57.452761 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a499d584-78de-497a-945c-350fb27058be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:57.454231 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a499d584-78de-497a-945c-350fb27058be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:57.455386 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a499d584-78de-497a-945c-350fb27058be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1724 microversion: 2.20 time: 0.158072 Dec 20 09:40:57.455982 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 754/1543] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:40:57 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:40:57.989315 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5c429d8d-3bdf-441a-b381-1094fb9e24a2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:57.990387 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-5c429d8d-3bdf-441a-b381-1094fb9e24a2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:57.996670 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5c429d8d-3bdf-441a-b381-1094fb9e24a2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:57.997123 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5c429d8d-3bdf-441a-b381-1094fb9e24a2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:57.997903 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5c429d8d-3bdf-441a-b381-1094fb9e24a2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:57.998341 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5c429d8d-3bdf-441a-b381-1094fb9e24a2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:58.060460 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-5c429d8d-3bdf-441a-b381-1094fb9e24a2 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.075976 Dec 20 09:40:58.061096 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 790/1544] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:57 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 09:40:58.474238 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9d29fd22-502e-4dc1-8b58-7c224a5680a2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:58.474833 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9d29fd22-502e-4dc1-8b58-7c224a5680a2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:58.481091 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9d29fd22-502e-4dc1-8b58-7c224a5680a2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:58.481528 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9d29fd22-502e-4dc1-8b58-7c224a5680a2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:58.482285 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9d29fd22-502e-4dc1-8b58-7c224a5680a2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:58.482717 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9d29fd22-502e-4dc1-8b58-7c224a5680a2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:58.610749 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-9d29fd22-502e-4dc1-8b58-7c224a5680a2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:58.618260 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-9d29fd22-502e-4dc1-8b58-7c224a5680a2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:58.619747 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-9d29fd22-502e-4dc1-8b58-7c224a5680a2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:58.620902 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9d29fd22-502e-4dc1-8b58-7c224a5680a2 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1724 microversion: 2.20 time: 0.150953 Dec 20 09:40:58.621470 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 755/1545] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:40:58 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:40:59.071603 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-eb8bbf54-7659-414c-8c60-ddf8004fdfce tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:59.072638 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-eb8bbf54-7659-414c-8c60-ddf8004fdfce tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:59.079502 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-eb8bbf54-7659-414c-8c60-ddf8004fdfce tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:59.079983 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-eb8bbf54-7659-414c-8c60-ddf8004fdfce tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:59.080768 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-eb8bbf54-7659-414c-8c60-ddf8004fdfce tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:59.081210 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-eb8bbf54-7659-414c-8c60-ddf8004fdfce tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:59.149992 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-eb8bbf54-7659-414c-8c60-ddf8004fdfce tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.082282 Dec 20 09:40:59.153953 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 791/1546] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:40:59 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:40:59.640868 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e1f3b550-2cee-4cd1-ae6f-48509cafb063 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:40:59.641480 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e1f3b550-2cee-4cd1-ae6f-48509cafb063 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:40:59.647669 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e1f3b550-2cee-4cd1-ae6f-48509cafb063 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:59.648141 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e1f3b550-2cee-4cd1-ae6f-48509cafb063 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:59.648930 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e1f3b550-2cee-4cd1-ae6f-48509cafb063 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:59.649366 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e1f3b550-2cee-4cd1-ae6f-48509cafb063 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:59.708617 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e1f3b550-2cee-4cd1-ae6f-48509cafb063 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:59.716315 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e1f3b550-2cee-4cd1-ae6f-48509cafb063 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:59.717799 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e1f3b550-2cee-4cd1-ae6f-48509cafb063 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b25e3e674c0e4530b1760b2a9d769851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ad93eaa3c541839f4737919bf7dc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:40:59.718969 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e1f3b550-2cee-4cd1-ae6f-48509cafb063 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 200 len: 1656 microversion: 2.20 time: 0.081806 Dec 20 09:40:59.719533 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 756/1547] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:40:59 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 1656 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 20 09:40:59.862252 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-3f362b82-af84-4950-91fe-19ebdae5f34f req-bc5a12f8-9974-4879-9268-abe40e0456e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9faf5b6c-7f96-4a91-b944-fd72f5665f64", "name": "network-vif-deleted", "tag": "4fac1673-dd2f-4368-bfcc-be873f33a32b"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:40:59.863773 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:40:59.863773 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:40:59.871456 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-3f362b82-af84-4950-91fe-19ebdae5f34f req-bc5a12f8-9974-4879-9268-abe40e0456e0 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:40:59.871996 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-3f362b82-af84-4950-91fe-19ebdae5f34f req-bc5a12f8-9974-4879-9268-abe40e0456e0 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:40:59.883311 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-3f362b82-af84-4950-91fe-19ebdae5f34f req-bc5a12f8-9974-4879-9268-abe40e0456e0 service nova] Creating event network-vif-deleted:4fac1673-dd2f-4368-bfcc-be873f33a32b for instance 9faf5b6c-7f96-4a91-b944-fd72f5665f64 on hv-cinder-81908 Dec 20 09:40:59.888479 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-3f362b82-af84-4950-91fe-19ebdae5f34f req-bc5a12f8-9974-4879-9268-abe40e0456e0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030429 Dec 20 09:40:59.889316 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 792/1548] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:40:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:41:00.161674 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8385b945-bd07-4446-a010-dffba65d9f46 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:00.162606 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8385b945-bd07-4446-a010-dffba65d9f46 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:00.168955 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8385b945-bd07-4446-a010-dffba65d9f46 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:00.169493 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8385b945-bd07-4446-a010-dffba65d9f46 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:00.170416 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8385b945-bd07-4446-a010-dffba65d9f46 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:00.170925 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8385b945-bd07-4446-a010-dffba65d9f46 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:00.231204 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8385b945-bd07-4446-a010-dffba65d9f46 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.073151 Dec 20 09:41:00.235384 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 757/1549] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:00 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:00.740125 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b4883db5-fed9-42b4-9674-6f00c1a24163 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:41:00.741449 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b4883db5-fed9-42b4-9674-6f00c1a24163 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:00.754950 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b4883db5-fed9-42b4-9674-6f00c1a24163 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:00.754950 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b4883db5-fed9-42b4-9674-6f00c1a24163 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:00.754950 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b4883db5-fed9-42b4-9674-6f00c1a24163 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:00.754950 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b4883db5-fed9-42b4-9674-6f00c1a24163 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:00.765401 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.wsgi [None req-b4883db5-fed9-42b4-9674-6f00c1a24163 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] HTTP exception thrown: Instance 9faf5b6c-7f96-4a91-b944-fd72f5665f64 could not be found. Dec 20 09:41:00.766161 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b4883db5-fed9-42b4-9674-6f00c1a24163 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Returning 404 to user: Instance 9faf5b6c-7f96-4a91-b944-fd72f5665f64 could not be found. {{(pid=116674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:41:00.767110 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b4883db5-fed9-42b4-9674-6f00c1a24163 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 404 len: 111 microversion: 2.20 time: 0.032417 Dec 20 09:41:00.767886 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 793/1550] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:41:00 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 20 09:41:00.782236 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-7332a858-0ab4-417d-94ad-071dde93c26d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '.version_select at 0x7f914f260700>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:41:00.882482 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-7332a858-0ab4-417d-94ad-071dde93c26d tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1328180579" status: 204 len: 0 microversion: 2.20 time: 0.108074 Dec 20 09:41:00.883071 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 758/1551] 10.222.0.62 () {60 vars in 1261 bytes} [Mon Dec 20 09:41:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1328180579 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 20 09:41:01.243490 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a3ed4fa1-3fa3-487e-ae34-2369c4f40dc1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:01.244466 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a3ed4fa1-3fa3-487e-ae34-2369c4f40dc1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:01.250685 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a3ed4fa1-3fa3-487e-ae34-2369c4f40dc1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:01.251139 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a3ed4fa1-3fa3-487e-ae34-2369c4f40dc1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:01.252070 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a3ed4fa1-3fa3-487e-ae34-2369c4f40dc1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:01.252519 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a3ed4fa1-3fa3-487e-ae34-2369c4f40dc1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:01.311870 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a3ed4fa1-3fa3-487e-ae34-2369c4f40dc1 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.071838 Dec 20 09:41:01.312518 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 794/1552] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:01 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:02.322796 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-10682f53-c12d-4983-b152-8089818d7f2d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:02.323861 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-10682f53-c12d-4983-b152-8089818d7f2d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:02.330222 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-10682f53-c12d-4983-b152-8089818d7f2d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:02.332851 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-10682f53-c12d-4983-b152-8089818d7f2d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:02.332851 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-10682f53-c12d-4983-b152-8089818d7f2d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:02.332851 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-10682f53-c12d-4983-b152-8089818d7f2d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:02.397758 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-10682f53-c12d-4983-b152-8089818d7f2d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.078541 Dec 20 09:41:02.398441 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 759/1553] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:02 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:02.921857 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9680790c-d37d-4ce7-a465-1533cf238a84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:41:02.922441 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9680790c-d37d-4ce7-a465-1533cf238a84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:02.929389 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9680790c-d37d-4ce7-a465-1533cf238a84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:02.929837 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9680790c-d37d-4ce7-a465-1533cf238a84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:02.930623 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9680790c-d37d-4ce7-a465-1533cf238a84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:02.931059 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9680790c-d37d-4ce7-a465-1533cf238a84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:02.944379 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.wsgi [None req-9680790c-d37d-4ce7-a465-1533cf238a84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] HTTP exception thrown: Instance 9faf5b6c-7f96-4a91-b944-fd72f5665f64 could not be found. Dec 20 09:41:02.944957 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9680790c-d37d-4ce7-a465-1533cf238a84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Returning 404 to user: Instance 9faf5b6c-7f96-4a91-b944-fd72f5665f64 could not be found. {{(pid=116674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:41:02.945772 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9680790c-d37d-4ce7-a465-1533cf238a84 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 404 len: 111 microversion: 2.20 time: 0.028022 Dec 20 09:41:02.946295 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 795/1554] 10.222.0.62 () {60 vars in 1279 bytes} [Mon Dec 20 09:41:02 2021] DELETE /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 20 09:41:02.954650 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4e063ab0-7972-4663-a663-72b2a27f4eca tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:41:02.955349 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4e063ab0-7972-4663-a663-72b2a27f4eca tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: 9faf5b6c-7f96-4a91-b944-fd72f5665f64] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:02.962684 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4e063ab0-7972-4663-a663-72b2a27f4eca tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:02.963128 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4e063ab0-7972-4663-a663-72b2a27f4eca tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:02.963934 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4e063ab0-7972-4663-a663-72b2a27f4eca tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:02.964367 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4e063ab0-7972-4663-a663-72b2a27f4eca tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:02.978686 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-4e063ab0-7972-4663-a663-72b2a27f4eca tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] HTTP exception thrown: Instance 9faf5b6c-7f96-4a91-b944-fd72f5665f64 could not be found. Dec 20 09:41:02.979267 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4e063ab0-7972-4663-a663-72b2a27f4eca tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Returning 404 to user: Instance 9faf5b6c-7f96-4a91-b944-fd72f5665f64 could not be found. {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:41:02.980108 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4e063ab0-7972-4663-a663-72b2a27f4eca tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64" status: 404 len: 111 microversion: 2.20 time: 0.029535 Dec 20 09:41:02.980634 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 760/1555] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:41:02 2021] GET /compute/v2.1/servers/9faf5b6c-7f96-4a91-b944-fd72f5665f64 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 20 09:41:03.409420 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-580d11d8-cf58-421d-8095-7d81669a9393 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:03.411192 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-580d11d8-cf58-421d-8095-7d81669a9393 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:03.417072 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-580d11d8-cf58-421d-8095-7d81669a9393 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:03.417522 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-580d11d8-cf58-421d-8095-7d81669a9393 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:03.418308 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-580d11d8-cf58-421d-8095-7d81669a9393 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:03.418741 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-580d11d8-cf58-421d-8095-7d81669a9393 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:03.480499 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-580d11d8-cf58-421d-8095-7d81669a9393 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.074699 Dec 20 09:41:03.481121 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 796/1556] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:03 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:04.224585 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-bdb6b4ac-8ae4-402c-82bf-a278369f77be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:41:04.225082 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-bdb6b4ac-8ae4-402c-82bf-a278369f77be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:04.231242 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bdb6b4ac-8ae4-402c-82bf-a278369f77be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:04.231730 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bdb6b4ac-8ae4-402c-82bf-a278369f77be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:04.232505 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bdb6b4ac-8ae4-402c-82bf-a278369f77be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:04.232938 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bdb6b4ac-8ae4-402c-82bf-a278369f77be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:04.250403 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-bdb6b4ac-8ae4-402c-82bf-a278369f77be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] HTTP exception thrown: Instance c9ba0eda-fab4-44dc-b41f-0c51574dca1f could not be found. Dec 20 09:41:04.250990 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-bdb6b4ac-8ae4-402c-82bf-a278369f77be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Returning 404 to user: Instance c9ba0eda-fab4-44dc-b41f-0c51574dca1f could not be found. {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:41:04.251838 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-bdb6b4ac-8ae4-402c-82bf-a278369f77be tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 404 len: 111 microversion: 2.20 time: 0.030912 Dec 20 09:41:04.252382 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 761/1557] 10.222.0.62 () {60 vars in 1279 bytes} [Mon Dec 20 09:41:04 2021] DELETE /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 20 09:41:04.261008 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-cc8048c2-4220-4e32-baf2-59416fee3360 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:41:04.261798 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-cc8048c2-4220-4e32-baf2-59416fee3360 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] [instance: c9ba0eda-fab4-44dc-b41f-0c51574dca1f] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:04.268617 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cc8048c2-4220-4e32-baf2-59416fee3360 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:04.269055 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cc8048c2-4220-4e32-baf2-59416fee3360 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:04.270483 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cc8048c2-4220-4e32-baf2-59416fee3360 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:04.270909 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cc8048c2-4220-4e32-baf2-59416fee3360 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:04.284413 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.wsgi [None req-cc8048c2-4220-4e32-baf2-59416fee3360 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] HTTP exception thrown: Instance c9ba0eda-fab4-44dc-b41f-0c51574dca1f could not be found. Dec 20 09:41:04.284978 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-cc8048c2-4220-4e32-baf2-59416fee3360 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] Returning 404 to user: Instance c9ba0eda-fab4-44dc-b41f-0c51574dca1f could not be found. {{(pid=116674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:41:04.285774 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-cc8048c2-4220-4e32-baf2-59416fee3360 tempest-AttachVolumeShelveTestJSON-1927710132 tempest-AttachVolumeShelveTestJSON-1927710132-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f" status: 404 len: 111 microversion: 2.20 time: 0.028770 Dec 20 09:41:04.286281 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 797/1558] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 20 09:41:04 2021] GET /compute/v2.1/servers/c9ba0eda-fab4-44dc-b41f-0c51574dca1f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 20 09:41:04.492665 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d28fa987-bde6-4744-9595-ce6a177fc780 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:04.493589 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d28fa987-bde6-4744-9595-ce6a177fc780 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:04.499880 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d28fa987-bde6-4744-9595-ce6a177fc780 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:04.500333 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d28fa987-bde6-4744-9595-ce6a177fc780 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:04.501109 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d28fa987-bde6-4744-9595-ce6a177fc780 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:04.501552 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d28fa987-bde6-4744-9595-ce6a177fc780 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:04.562158 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d28fa987-bde6-4744-9595-ce6a177fc780 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.073584 Dec 20 09:41:04.565847 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 762/1559] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:04 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:05.573780 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e19e0734-4946-4e2c-a2f4-cd8c470b245d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:05.574845 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e19e0734-4946-4e2c-a2f4-cd8c470b245d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:05.581153 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e19e0734-4946-4e2c-a2f4-cd8c470b245d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:05.581543 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e19e0734-4946-4e2c-a2f4-cd8c470b245d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:05.582887 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e19e0734-4946-4e2c-a2f4-cd8c470b245d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:05.582887 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e19e0734-4946-4e2c-a2f4-cd8c470b245d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:05.645034 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e19e0734-4946-4e2c-a2f4-cd8c470b245d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.074744 Dec 20 09:41:05.645698 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 798/1560] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:05 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:06.656576 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9b1f850a-0362-43c7-91e4-3a9183244653 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:06.657821 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9b1f850a-0362-43c7-91e4-3a9183244653 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:06.665888 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9b1f850a-0362-43c7-91e4-3a9183244653 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:06.666342 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9b1f850a-0362-43c7-91e4-3a9183244653 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:06.667235 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9b1f850a-0362-43c7-91e4-3a9183244653 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:06.667812 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9b1f850a-0362-43c7-91e4-3a9183244653 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:06.732769 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9b1f850a-0362-43c7-91e4-3a9183244653 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.080083 Dec 20 09:41:06.734179 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 763/1561] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:06 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:07.745307 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d5dd8261-9f14-405f-b468-d5fb4f0fd082 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:07.747022 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d5dd8261-9f14-405f-b468-d5fb4f0fd082 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:07.755176 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d5dd8261-9f14-405f-b468-d5fb4f0fd082 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:07.755629 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d5dd8261-9f14-405f-b468-d5fb4f0fd082 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:07.760322 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d5dd8261-9f14-405f-b468-d5fb4f0fd082 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:07.760877 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d5dd8261-9f14-405f-b468-d5fb4f0fd082 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:07.829967 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d5dd8261-9f14-405f-b468-d5fb4f0fd082 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.089226 Dec 20 09:41:07.830657 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 799/1562] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:07 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:08.842807 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-af168a23-e6f3-4338-9939-291b460b1ccc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:08.844066 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-af168a23-e6f3-4338-9939-291b460b1ccc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:08.852193 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-af168a23-e6f3-4338-9939-291b460b1ccc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:08.852643 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-af168a23-e6f3-4338-9939-291b460b1ccc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:08.853414 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-af168a23-e6f3-4338-9939-291b460b1ccc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:08.853846 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-af168a23-e6f3-4338-9939-291b460b1ccc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:08.925739 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-af168a23-e6f3-4338-9939-291b460b1ccc tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.086741 Dec 20 09:41:08.926594 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 764/1563] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:08 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:09.937628 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b125da7a-9bd7-42f3-989a-4487115eaaa0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:09.938603 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b125da7a-9bd7-42f3-989a-4487115eaaa0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:09.946088 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b125da7a-9bd7-42f3-989a-4487115eaaa0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:09.946535 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b125da7a-9bd7-42f3-989a-4487115eaaa0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:09.947310 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b125da7a-9bd7-42f3-989a-4487115eaaa0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:09.947787 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b125da7a-9bd7-42f3-989a-4487115eaaa0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:10.009884 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b125da7a-9bd7-42f3-989a-4487115eaaa0 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.076287 Dec 20 09:41:10.013845 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 800/1564] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:09 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:11.022613 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6a592d57-1c34-4873-a728-421931412aa8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:11.023564 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6a592d57-1c34-4873-a728-421931412aa8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:11.030353 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6a592d57-1c34-4873-a728-421931412aa8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:11.030806 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6a592d57-1c34-4873-a728-421931412aa8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:11.031586 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6a592d57-1c34-4873-a728-421931412aa8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:11.032061 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6a592d57-1c34-4873-a728-421931412aa8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:11.091649 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6a592d57-1c34-4873-a728-421931412aa8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.073438 Dec 20 09:41:11.092335 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 765/1565] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:11 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:12.103357 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-399408f3-7e04-4ada-b0ad-80cbcdc28b35 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:12.104393 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-399408f3-7e04-4ada-b0ad-80cbcdc28b35 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:12.111904 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-399408f3-7e04-4ada-b0ad-80cbcdc28b35 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:12.112471 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-399408f3-7e04-4ada-b0ad-80cbcdc28b35 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:12.113640 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-399408f3-7e04-4ada-b0ad-80cbcdc28b35 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:12.114081 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-399408f3-7e04-4ada-b0ad-80cbcdc28b35 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:12.194754 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-399408f3-7e04-4ada-b0ad-80cbcdc28b35 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.084354 Dec 20 09:41:12.194754 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 801/1566] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:12 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:13.204147 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4145a2d0-ba9b-4464-8b7c-e4ee31a913ff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:13.205446 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4145a2d0-ba9b-4464-8b7c-e4ee31a913ff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:13.212133 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4145a2d0-ba9b-4464-8b7c-e4ee31a913ff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:13.212589 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4145a2d0-ba9b-4464-8b7c-e4ee31a913ff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:13.213361 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4145a2d0-ba9b-4464-8b7c-e4ee31a913ff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:13.213795 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4145a2d0-ba9b-4464-8b7c-e4ee31a913ff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:13.287411 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4145a2d0-ba9b-4464-8b7c-e4ee31a913ff tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.087148 Dec 20 09:41:13.288102 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 766/1567] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:13 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:14.298770 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a3be0f89-b648-45b0-ba1c-7e6032e607f4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:14.299794 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a3be0f89-b648-45b0-ba1c-7e6032e607f4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:14.307072 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a3be0f89-b648-45b0-ba1c-7e6032e607f4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:14.307516 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a3be0f89-b648-45b0-ba1c-7e6032e607f4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:14.308318 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a3be0f89-b648-45b0-ba1c-7e6032e607f4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:14.308751 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a3be0f89-b648-45b0-ba1c-7e6032e607f4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:14.372375 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a3be0f89-b648-45b0-ba1c-7e6032e607f4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.077441 Dec 20 09:41:14.373225 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 802/1568] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:14 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:15.384865 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f04cb2c8-051a-4883-b151-9e47c0adc572 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:15.385869 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f04cb2c8-051a-4883-b151-9e47c0adc572 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:15.392696 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f04cb2c8-051a-4883-b151-9e47c0adc572 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:15.393146 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f04cb2c8-051a-4883-b151-9e47c0adc572 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:15.393924 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f04cb2c8-051a-4883-b151-9e47c0adc572 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:15.394917 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f04cb2c8-051a-4883-b151-9e47c0adc572 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:15.463730 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f04cb2c8-051a-4883-b151-9e47c0adc572 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.082731 Dec 20 09:41:15.464381 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 767/1569] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:15 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:16.475940 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c5b4a92a-b9c1-466a-957d-5f01271b309a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:16.476944 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c5b4a92a-b9c1-466a-957d-5f01271b309a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:16.483752 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c5b4a92a-b9c1-466a-957d-5f01271b309a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:16.484202 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c5b4a92a-b9c1-466a-957d-5f01271b309a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:16.485237 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c5b4a92a-b9c1-466a-957d-5f01271b309a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:16.485672 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c5b4a92a-b9c1-466a-957d-5f01271b309a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:16.555076 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c5b4a92a-b9c1-466a-957d-5f01271b309a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.083028 Dec 20 09:41:16.555904 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 803/1570] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:16 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:17.567307 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0ab63e79-9c40-4c6e-94ac-c2197c3da7c5 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:17.568371 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0ab63e79-9c40-4c6e-94ac-c2197c3da7c5 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:17.575313 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0ab63e79-9c40-4c6e-94ac-c2197c3da7c5 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:17.575813 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0ab63e79-9c40-4c6e-94ac-c2197c3da7c5 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:17.576587 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0ab63e79-9c40-4c6e-94ac-c2197c3da7c5 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:17.577025 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0ab63e79-9c40-4c6e-94ac-c2197c3da7c5 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:17.636158 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0ab63e79-9c40-4c6e-94ac-c2197c3da7c5 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.073213 Dec 20 09:41:17.637062 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 768/1571] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:17 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:18.649817 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7437a143-8b8b-4576-b976-359143cb817f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:18.650822 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7437a143-8b8b-4576-b976-359143cb817f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:18.657654 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7437a143-8b8b-4576-b976-359143cb817f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:18.658099 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7437a143-8b8b-4576-b976-359143cb817f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:18.658878 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7437a143-8b8b-4576-b976-359143cb817f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:18.659358 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7437a143-8b8b-4576-b976-359143cb817f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:18.719925 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7437a143-8b8b-4576-b976-359143cb817f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.074010 Dec 20 09:41:18.720549 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 804/1572] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:18 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:19.732450 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4df9a30b-cba4-4175-a0e0-44e919dabd80 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:19.733447 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4df9a30b-cba4-4175-a0e0-44e919dabd80 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:19.740543 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4df9a30b-cba4-4175-a0e0-44e919dabd80 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:19.740993 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4df9a30b-cba4-4175-a0e0-44e919dabd80 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:19.741762 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4df9a30b-cba4-4175-a0e0-44e919dabd80 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:19.742195 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4df9a30b-cba4-4175-a0e0-44e919dabd80 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:19.802742 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4df9a30b-cba4-4175-a0e0-44e919dabd80 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.074044 Dec 20 09:41:19.803440 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 769/1573] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:19 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:20.814889 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-02c7c434-0d1d-4702-936d-446f303a763d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:20.815826 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-02c7c434-0d1d-4702-936d-446f303a763d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:20.822666 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-02c7c434-0d1d-4702-936d-446f303a763d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:20.823112 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-02c7c434-0d1d-4702-936d-446f303a763d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:20.823912 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-02c7c434-0d1d-4702-936d-446f303a763d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:20.824455 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-02c7c434-0d1d-4702-936d-446f303a763d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:20.883082 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-02c7c434-0d1d-4702-936d-446f303a763d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.072127 Dec 20 09:41:20.883793 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 805/1574] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:20 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:21.894796 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d1198d78-3f39-4df2-a885-95b3ad9ce551 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:21.895861 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d1198d78-3f39-4df2-a885-95b3ad9ce551 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:21.902726 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1198d78-3f39-4df2-a885-95b3ad9ce551 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:21.903172 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1198d78-3f39-4df2-a885-95b3ad9ce551 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:21.903960 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1198d78-3f39-4df2-a885-95b3ad9ce551 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:21.904402 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1198d78-3f39-4df2-a885-95b3ad9ce551 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:21.965385 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d1198d78-3f39-4df2-a885-95b3ad9ce551 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.074424 Dec 20 09:41:21.966302 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 770/1575] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:21 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:22.979451 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-556f909e-22a9-423e-9e43-450623c574ef tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:22.980440 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-556f909e-22a9-423e-9e43-450623c574ef tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:22.991770 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-556f909e-22a9-423e-9e43-450623c574ef tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:22.992498 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-556f909e-22a9-423e-9e43-450623c574ef tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:22.993392 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-556f909e-22a9-423e-9e43-450623c574ef tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:22.993830 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-556f909e-22a9-423e-9e43-450623c574ef tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:23.059826 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-556f909e-22a9-423e-9e43-450623c574ef tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.084581 Dec 20 09:41:23.060481 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 806/1576] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:22 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:24.071905 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9aeeb258-932b-46c3-ac38-5de3c06dae1c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:24.072907 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9aeeb258-932b-46c3-ac38-5de3c06dae1c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:24.079714 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9aeeb258-932b-46c3-ac38-5de3c06dae1c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:24.080173 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9aeeb258-932b-46c3-ac38-5de3c06dae1c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:24.080947 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9aeeb258-932b-46c3-ac38-5de3c06dae1c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:24.081386 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9aeeb258-932b-46c3-ac38-5de3c06dae1c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:24.141476 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9aeeb258-932b-46c3-ac38-5de3c06dae1c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.073541 Dec 20 09:41:24.142107 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 771/1577] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:24 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:25.156890 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-fd881348-e06f-4d3d-a11d-298b00c1facf tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:25.157900 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-fd881348-e06f-4d3d-a11d-298b00c1facf tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:25.164978 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fd881348-e06f-4d3d-a11d-298b00c1facf tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:25.165426 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fd881348-e06f-4d3d-a11d-298b00c1facf tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:25.166268 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fd881348-e06f-4d3d-a11d-298b00c1facf tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:25.166774 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fd881348-e06f-4d3d-a11d-298b00c1facf tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:25.228701 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-fd881348-e06f-4d3d-a11d-298b00c1facf tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28678 microversion: 2.1 time: 0.076443 Dec 20 09:41:25.229953 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 807/1578] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:25 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28678 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:26.242915 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8a986343-4ac9-459c-bdff-898ef3be7df7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:26.242915 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8a986343-4ac9-459c-bdff-898ef3be7df7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:26.249018 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8a986343-4ac9-459c-bdff-898ef3be7df7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:26.249503 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8a986343-4ac9-459c-bdff-898ef3be7df7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:26.250295 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8a986343-4ac9-459c-bdff-898ef3be7df7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:26.250734 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8a986343-4ac9-459c-bdff-898ef3be7df7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:26.334372 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8a986343-4ac9-459c-bdff-898ef3be7df7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 28825 microversion: 2.1 time: 0.097933 Dec 20 09:41:26.335185 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 772/1579] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:26 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 28825 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:27.345604 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a2d29166-6649-43e0-a868-c7e4c1e5858a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:27.346607 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a2d29166-6649-43e0-a868-c7e4c1e5858a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:27.354047 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a2d29166-6649-43e0-a868-c7e4c1e5858a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:27.354492 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a2d29166-6649-43e0-a868-c7e4c1e5858a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:27.355266 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a2d29166-6649-43e0-a868-c7e4c1e5858a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:27.355727 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a2d29166-6649-43e0-a868-c7e4c1e5858a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:27.432797 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a2d29166-6649-43e0-a868-c7e4c1e5858a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 30948 microversion: 2.1 time: 0.090946 Dec 20 09:41:27.433463 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 808/1580] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:27 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 30948 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:28.445634 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f2b77009-7fff-429d-815f-fa4d5ab65d0f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:28.446630 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f2b77009-7fff-429d-815f-fa4d5ab65d0f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:28.453401 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f2b77009-7fff-429d-815f-fa4d5ab65d0f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:28.453841 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f2b77009-7fff-429d-815f-fa4d5ab65d0f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:28.454638 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f2b77009-7fff-429d-815f-fa4d5ab65d0f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:28.455064 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f2b77009-7fff-429d-815f-fa4d5ab65d0f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:28.523970 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f2b77009-7fff-429d-815f-fa4d5ab65d0f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 32698 microversion: 2.1 time: 0.082735 Dec 20 09:41:28.524722 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 773/1581] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:28 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 32698 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 20 09:41:29.536027 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d466687f-37f9-485e-bd2c-1a5cbd8b6ba8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:29.537473 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d466687f-37f9-485e-bd2c-1a5cbd8b6ba8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:29.544304 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d466687f-37f9-485e-bd2c-1a5cbd8b6ba8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:29.544750 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d466687f-37f9-485e-bd2c-1a5cbd8b6ba8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:29.545531 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d466687f-37f9-485e-bd2c-1a5cbd8b6ba8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:29.545966 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d466687f-37f9-485e-bd2c-1a5cbd8b6ba8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:29.628698 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d466687f-37f9-485e-bd2c-1a5cbd8b6ba8 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 33799 microversion: 2.1 time: 0.096649 Dec 20 09:41:29.629357 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 809/1582] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:29 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 33799 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:30.640904 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-58bc52dc-a8a2-4e61-a0bf-45dc898faf02 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:30.641913 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-58bc52dc-a8a2-4e61-a0bf-45dc898faf02 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:30.648854 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-58bc52dc-a8a2-4e61-a0bf-45dc898faf02 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:30.658152 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-58bc52dc-a8a2-4e61-a0bf-45dc898faf02 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:30.658152 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-58bc52dc-a8a2-4e61-a0bf-45dc898faf02 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:30.658152 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-58bc52dc-a8a2-4e61-a0bf-45dc898faf02 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:30.720931 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-58bc52dc-a8a2-4e61-a0bf-45dc898faf02 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 35035 microversion: 2.1 time: 0.083961 Dec 20 09:41:30.722193 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 774/1583] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:30 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 35035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:31.733520 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-fe5f90b9-1370-4fd3-82cc-b18bb2a91d42 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:31.734823 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-fe5f90b9-1370-4fd3-82cc-b18bb2a91d42 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:31.741971 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fe5f90b9-1370-4fd3-82cc-b18bb2a91d42 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:31.742416 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fe5f90b9-1370-4fd3-82cc-b18bb2a91d42 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:31.743191 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fe5f90b9-1370-4fd3-82cc-b18bb2a91d42 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:31.743614 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fe5f90b9-1370-4fd3-82cc-b18bb2a91d42 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:31.817790 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-fe5f90b9-1370-4fd3-82cc-b18bb2a91d42 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 36256 microversion: 2.1 time: 0.088396 Dec 20 09:41:31.820580 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 810/1584] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:31 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 36256 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:32.839797 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-83a13a85-3544-4c56-8162-6fc46bf6eadd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:32.841505 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-83a13a85-3544-4c56-8162-6fc46bf6eadd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:32.848503 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-83a13a85-3544-4c56-8162-6fc46bf6eadd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:32.849041 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-83a13a85-3544-4c56-8162-6fc46bf6eadd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:32.849887 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-83a13a85-3544-4c56-8162-6fc46bf6eadd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:32.851028 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-83a13a85-3544-4c56-8162-6fc46bf6eadd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:32.924843 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-83a13a85-3544-4c56-8162-6fc46bf6eadd tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 37947 microversion: 2.1 time: 0.095805 Dec 20 09:41:32.925491 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 775/1585] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:32 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 37947 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:33.937226 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-44d08fc4-10df-4d3e-9887-f75cd50fbb6e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:33.938233 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-44d08fc4-10df-4d3e-9887-f75cd50fbb6e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:33.945065 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-44d08fc4-10df-4d3e-9887-f75cd50fbb6e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:33.945516 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-44d08fc4-10df-4d3e-9887-f75cd50fbb6e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:33.946296 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-44d08fc4-10df-4d3e-9887-f75cd50fbb6e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:33.946733 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-44d08fc4-10df-4d3e-9887-f75cd50fbb6e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:34.019112 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-44d08fc4-10df-4d3e-9887-f75cd50fbb6e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 38212 microversion: 2.1 time: 0.085782 Dec 20 09:41:34.019835 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 811/1586] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:33 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 38212 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:35.030685 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-550e4dbd-381a-4aac-9b82-1d39facb08fb tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:35.031731 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-550e4dbd-381a-4aac-9b82-1d39facb08fb tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:35.038606 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-550e4dbd-381a-4aac-9b82-1d39facb08fb tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:35.039062 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-550e4dbd-381a-4aac-9b82-1d39facb08fb tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:35.039880 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-550e4dbd-381a-4aac-9b82-1d39facb08fb tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:35.040324 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-550e4dbd-381a-4aac-9b82-1d39facb08fb tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:35.103587 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-550e4dbd-381a-4aac-9b82-1d39facb08fb tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 38212 microversion: 2.1 time: 0.076769 Dec 20 09:41:35.104298 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 776/1587] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:35 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 38212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:36.115185 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-fb4b9dea-2767-4e8c-91af-1d62ab7f7f0c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:36.116307 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-fb4b9dea-2767-4e8c-91af-1d62ab7f7f0c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:36.122997 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fb4b9dea-2767-4e8c-91af-1d62ab7f7f0c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:36.123456 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fb4b9dea-2767-4e8c-91af-1d62ab7f7f0c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:36.124262 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fb4b9dea-2767-4e8c-91af-1d62ab7f7f0c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:36.124701 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fb4b9dea-2767-4e8c-91af-1d62ab7f7f0c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:36.185730 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-fb4b9dea-2767-4e8c-91af-1d62ab7f7f0c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 38212 microversion: 2.1 time: 0.074425 Dec 20 09:41:36.186635 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 812/1588] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:36 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 38212 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:37.197791 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9bb701d9-7386-43c4-86e4-98e86eb39789 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:37.198834 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9bb701d9-7386-43c4-86e4-98e86eb39789 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:37.205704 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9bb701d9-7386-43c4-86e4-98e86eb39789 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:37.206156 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9bb701d9-7386-43c4-86e4-98e86eb39789 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:37.206936 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9bb701d9-7386-43c4-86e4-98e86eb39789 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:37.207375 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9bb701d9-7386-43c4-86e4-98e86eb39789 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:37.268265 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9bb701d9-7386-43c4-86e4-98e86eb39789 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 38212 microversion: 2.1 time: 0.074455 Dec 20 09:41:37.268933 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 777/1589] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:37 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 38212 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:38.281002 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a8197b02-e78f-4a13-b1ae-9323448d1f82 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:38.282006 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a8197b02-e78f-4a13-b1ae-9323448d1f82 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:38.289380 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a8197b02-e78f-4a13-b1ae-9323448d1f82 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:38.289835 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a8197b02-e78f-4a13-b1ae-9323448d1f82 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:38.290613 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a8197b02-e78f-4a13-b1ae-9323448d1f82 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:38.291052 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a8197b02-e78f-4a13-b1ae-9323448d1f82 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:38.363984 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a8197b02-e78f-4a13-b1ae-9323448d1f82 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action" status: 200 len: 38343 microversion: 2.1 time: 0.086696 Dec 20 09:41:38.364552 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 813/1590] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 20 09:41:38 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/action => generated 38343 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 20 09:41:38.375239 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8adf443d-7b15-425d-93fe-b6afbcbcc041 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:41:38.375857 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8adf443d-7b15-425d-93fe-b6afbcbcc041 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:38.382652 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8adf443d-7b15-425d-93fe-b6afbcbcc041 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:38.383108 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8adf443d-7b15-425d-93fe-b6afbcbcc041 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:38.383923 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8adf443d-7b15-425d-93fe-b6afbcbcc041 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:38.384367 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8adf443d-7b15-425d-93fe-b6afbcbcc041 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:38.410514 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8adf443d-7b15-425d-93fe-b6afbcbcc041 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/ips" status: 200 len: 145 microversion: 2.1 time: 0.038625 Dec 20 09:41:38.411505 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 778/1591] 10.222.0.62 () {58 vars in 1247 bytes} [Mon Dec 20 09:41:38 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:41:39.980184 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b1acdb61-0dcc-4c90-921f-b4cafa5bd604 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d100268f-2078-4b82-bcde-2126ccb89cca"}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:39.981337 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b1acdb61-0dcc-4c90-921f-b4cafa5bd604 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:39.988649 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b1acdb61-0dcc-4c90-921f-b4cafa5bd604 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:39.989101 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b1acdb61-0dcc-4c90-921f-b4cafa5bd604 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:39.989894 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b1acdb61-0dcc-4c90-921f-b4cafa5bd604 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:39.990332 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b1acdb61-0dcc-4c90-921f-b4cafa5bd604 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:40.716535 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b1acdb61-0dcc-4c90-921f-b4cafa5bd604 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.740327 Dec 20 09:41:40.717074 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 814/1592] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 20 09:41:39 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-volume_attachments => generated 194 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:41:52.276721 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 20 09:41:52.277677 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: Mon Dec 20 09:41:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 20 09:41:52.380490 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-09e5b14f-8c5a-4c34-94d2-e12abc82646e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:41:52.381415 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-09e5b14f-8c5a-4c34-94d2-e12abc82646e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:52.387218 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-09e5b14f-8c5a-4c34-94d2-e12abc82646e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:52.387685 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-09e5b14f-8c5a-4c34-94d2-e12abc82646e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:52.388482 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-09e5b14f-8c5a-4c34-94d2-e12abc82646e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:52.388921 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-09e5b14f-8c5a-4c34-94d2-e12abc82646e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:52.419420 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-09e5b14f-8c5a-4c34-94d2-e12abc82646e tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043131 Dec 20 09:41:52.420221 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 779/1593] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:41:52 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:41:52.430626 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-074e93d1-ec69-466c-908a-2b363f67c54d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:41:52.431215 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-074e93d1-ec69-466c-908a-2b363f67c54d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:52.438365 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-074e93d1-ec69-466c-908a-2b363f67c54d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:52.438813 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-074e93d1-ec69-466c-908a-2b363f67c54d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:52.439597 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-074e93d1-ec69-466c-908a-2b363f67c54d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:52.440061 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-074e93d1-ec69-466c-908a-2b363f67c54d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:52.469117 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-074e93d1-ec69-466c-908a-2b363f67c54d tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-volume_attachments/d100268f-2078-4b82-bcde-2126ccb89cca" status: 200 len: 194 microversion: 2.1 time: 0.043056 Dec 20 09:41:52.469696 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 815/1594] 10.222.0.62 () {58 vars in 1412 bytes} [Mon Dec 20 09:41:52 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-volume_attachments/d100268f-2078-4b82-bcde-2126ccb89cca => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:41:54.107352 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d8da0285-f50b-4b75-8271-5992560b819f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe542c7f-8c38-4cc7-82e2-f7673f09e9e5"}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:54.109384 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d8da0285-f50b-4b75-8271-5992560b819f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:54.115822 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d8da0285-f50b-4b75-8271-5992560b819f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:54.116281 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d8da0285-f50b-4b75-8271-5992560b819f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:54.117080 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d8da0285-f50b-4b75-8271-5992560b819f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:54.117520 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d8da0285-f50b-4b75-8271-5992560b819f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:54.883752 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d8da0285-f50b-4b75-8271-5992560b819f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.782522 Dec 20 09:41:54.884795 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 780/1595] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 20 09:41:54 2021] POST /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-volume_attachments => generated 194 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:41:55.682964 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-fbcf2821-219b-44c7-b131-f6cd0db1c1f8 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:41:55.683517 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-fbcf2821-219b-44c7-b131-f6cd0db1c1f8 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:55.684961 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-7445a473-05a5-4890-8d1c-f0d28f37895a req-c47608af-630d-4401-861c-556806bff437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2454a5d-038c-422c-8b61-b88674e18a3c", "tag": "4bfd2d96-5b20-4456-afea-5b3bbf0b1cfe"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:55.692018 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fbcf2821-219b-44c7-b131-f6cd0db1c1f8 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:55.692543 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:41:55.692543 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:41:55.698181 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fbcf2821-219b-44c7-b131-f6cd0db1c1f8 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:55.699014 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fbcf2821-219b-44c7-b131-f6cd0db1c1f8 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:55.703815 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-7445a473-05a5-4890-8d1c-f0d28f37895a req-c47608af-630d-4401-861c-556806bff437 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:55.704265 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-7445a473-05a5-4890-8d1c-f0d28f37895a req-c47608af-630d-4401-861c-556806bff437 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:55.707150 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fbcf2821-219b-44c7-b131-f6cd0db1c1f8 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:55.721395 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-7445a473-05a5-4890-8d1c-f0d28f37895a req-c47608af-630d-4401-861c-556806bff437 service nova] Creating event network-changed:4bfd2d96-5b20-4456-afea-5b3bbf0b1cfe for instance b2454a5d-038c-422c-8b61-b88674e18a3c on hv-cinder-81908 Dec 20 09:41:55.726381 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-7445a473-05a5-4890-8d1c-f0d28f37895a req-c47608af-630d-4401-861c-556806bff437 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049790 Dec 20 09:41:55.727420 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 781/1596] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:41:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:41:55.739190 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-fbcf2821-219b-44c7-b131-f6cd0db1c1f8 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Going to try to terminate instance {{(pid=116674) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 09:41:56.051062 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-fbcf2821-219b-44c7-b131-f6cd0db1c1f8 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 204 len: 0 microversion: 2.1 time: 0.376845 Dec 20 09:41:56.052159 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 816/1597] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 20 09:41:55 2021] DELETE /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 09:41:56.060634 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-65da5711-c7dd-42f7-99a4-0cdcda8966a9 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:41:56.062420 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-65da5711-c7dd-42f7-99a4-0cdcda8966a9 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:56.069991 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-65da5711-c7dd-42f7-99a4-0cdcda8966a9 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:56.070541 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-65da5711-c7dd-42f7-99a4-0cdcda8966a9 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:56.071402 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-65da5711-c7dd-42f7-99a4-0cdcda8966a9 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:56.071879 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-65da5711-c7dd-42f7-99a4-0cdcda8966a9 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:56.227507 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-65da5711-c7dd-42f7-99a4-0cdcda8966a9 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:41:56.234852 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-65da5711-c7dd-42f7-99a4-0cdcda8966a9 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1569 microversion: 2.1 time: 0.178787 Dec 20 09:41:56.235487 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 782/1598] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:41:56 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:41:57.252123 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8215cf99-4626-4024-8801-ef9737aa87e1 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:41:57.252848 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-8215cf99-4626-4024-8801-ef9737aa87e1 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:57.259150 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8215cf99-4626-4024-8801-ef9737aa87e1 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:57.259597 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8215cf99-4626-4024-8801-ef9737aa87e1 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:57.260424 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8215cf99-4626-4024-8801-ef9737aa87e1 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:57.260887 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8215cf99-4626-4024-8801-ef9737aa87e1 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:57.398426 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-8215cf99-4626-4024-8801-ef9737aa87e1 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:41:57.406178 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8215cf99-4626-4024-8801-ef9737aa87e1 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1450 microversion: 2.1 time: 0.157964 Dec 20 09:41:57.406766 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 817/1599] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:41:57 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:41:58.204529 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-145dd91f-705c-4734-9e05-e45db52596ee req-b855d880-fa8b-4e4d-affc-4ef90ed38833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2454a5d-038c-422c-8b61-b88674e18a3c", "name": "network-vif-deleted", "tag": "4bfd2d96-5b20-4456-afea-5b3bbf0b1cfe"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:41:58.206018 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:41:58.206018 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:41:58.213612 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-145dd91f-705c-4734-9e05-e45db52596ee req-b855d880-fa8b-4e4d-affc-4ef90ed38833 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:58.214047 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-145dd91f-705c-4734-9e05-e45db52596ee req-b855d880-fa8b-4e4d-affc-4ef90ed38833 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:58.225305 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-145dd91f-705c-4734-9e05-e45db52596ee req-b855d880-fa8b-4e4d-affc-4ef90ed38833 service nova] Creating event network-vif-deleted:4bfd2d96-5b20-4456-afea-5b3bbf0b1cfe for instance b2454a5d-038c-422c-8b61-b88674e18a3c on hv-cinder-81908 Dec 20 09:41:58.230007 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-145dd91f-705c-4734-9e05-e45db52596ee req-b855d880-fa8b-4e4d-affc-4ef90ed38833 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029031 Dec 20 09:41:58.230561 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 783/1600] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:41:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:41:58.424493 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0c347679-9318-48e7-8824-0cedefdf14cd tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:41:58.425142 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0c347679-9318-48e7-8824-0cedefdf14cd tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:58.431375 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0c347679-9318-48e7-8824-0cedefdf14cd tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:58.431867 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0c347679-9318-48e7-8824-0cedefdf14cd tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:58.432662 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0c347679-9318-48e7-8824-0cedefdf14cd tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:58.433274 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0c347679-9318-48e7-8824-0cedefdf14cd tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:58.501719 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-0c347679-9318-48e7-8824-0cedefdf14cd tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:41:58.509478 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0c347679-9318-48e7-8824-0cedefdf14cd tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1219 microversion: 2.1 time: 0.088634 Dec 20 09:41:58.510132 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 818/1601] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:41:58 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:41:59.527337 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d1859a76-88d9-4bf2-a8a6-f450a6962fca tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:41:59.528060 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d1859a76-88d9-4bf2-a8a6-f450a6962fca tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:41:59.534332 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1859a76-88d9-4bf2-a8a6-f450a6962fca tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:59.534786 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1859a76-88d9-4bf2-a8a6-f450a6962fca tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:59.535571 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1859a76-88d9-4bf2-a8a6-f450a6962fca tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:59.536057 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1859a76-88d9-4bf2-a8a6-f450a6962fca tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:59.568593 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1859a76-88d9-4bf2-a8a6-f450a6962fca tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:41:59.569039 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1859a76-88d9-4bf2-a8a6-f450a6962fca tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:41:59.569484 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.objects.instance [None req-d1859a76-88d9-4bf2-a8a6-f450a6962fca tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lazy-loading 'fault' on Instance uuid b2454a5d-038c-422c-8b61-b88674e18a3c {{(pid=116675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:41:59.610138 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d1859a76-88d9-4bf2-a8a6-f450a6962fca tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427653540434b0abbea7950c81e4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3273ceb50413452bb9e132e4a98437b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:41:59.618515 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d1859a76-88d9-4bf2-a8a6-f450a6962fca tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 200 len: 1178 microversion: 2.1 time: 0.095813 Dec 20 09:41:59.619108 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 784/1602] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:41:59 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 1178 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:42:00.635724 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a398fb78-3158-49f7-a230-8e66acb684d0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:00.636484 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-a398fb78-3158-49f7-a230-8e66acb684d0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] [instance: b2454a5d-038c-422c-8b61-b88674e18a3c] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:42:00.642723 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a398fb78-3158-49f7-a230-8e66acb684d0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:00.643172 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a398fb78-3158-49f7-a230-8e66acb684d0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:00.643978 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a398fb78-3158-49f7-a230-8e66acb684d0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:00.644418 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-a398fb78-3158-49f7-a230-8e66acb684d0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:00.658162 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.wsgi [None req-a398fb78-3158-49f7-a230-8e66acb684d0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] HTTP exception thrown: Instance b2454a5d-038c-422c-8b61-b88674e18a3c could not be found. Dec 20 09:42:00.658792 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a398fb78-3158-49f7-a230-8e66acb684d0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Returning 404 to user: Instance b2454a5d-038c-422c-8b61-b88674e18a3c could not be found. {{(pid=116674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:42:00.659607 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a398fb78-3158-49f7-a230-8e66acb684d0 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c" status: 404 len: 111 microversion: 2.1 time: 0.027689 Dec 20 09:42:00.664603 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 819/1603] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:42:00 2021] GET /compute/v2.1/servers/b2454a5d-038c-422c-8b61-b88674e18a3c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:42:00.907440 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-3bd6aa74-99f3-4ba8-88b5-435f5e723498 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] Calling method '.version_select at 0x7f91538e21f0>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:01.011869 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-3bd6aa74-99f3-4ba8-88b5-435f5e723498 tempest-TestShelveInstance-53022704 tempest-TestShelveInstance-53022704-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1875582186" status: 202 len: 0 microversion: 2.1 time: 0.108151 Dec 20 09:42:01.012607 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 785/1604] 10.222.0.62 () {58 vars in 1253 bytes} [Mon Dec 20 09:42:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1875582186 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:42:02.361459 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-de6bf066-6644-4b53-b4ab-4c39988cbc31 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:02.362507 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-de6bf066-6644-4b53-b4ab-4c39988cbc31 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:42:02.369544 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-de6bf066-6644-4b53-b4ab-4c39988cbc31 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:02.369986 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-de6bf066-6644-4b53-b4ab-4c39988cbc31 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:02.373214 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-de6bf066-6644-4b53-b4ab-4c39988cbc31 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:02.373214 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-de6bf066-6644-4b53-b4ab-4c39988cbc31 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:02.401807 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-de6bf066-6644-4b53-b4ab-4c39988cbc31 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044402 Dec 20 09:42:02.402382 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 820/1605] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:42:02 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:42:02.639700 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1c478899-0808-4e1f-ad8b-653b1b492a6f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:02.640499 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-1c478899-0808-4e1f-ad8b-653b1b492a6f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:42:02.649293 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1c478899-0808-4e1f-ad8b-653b1b492a6f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:02.649818 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1c478899-0808-4e1f-ad8b-653b1b492a6f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:02.650681 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1c478899-0808-4e1f-ad8b-653b1b492a6f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:02.651191 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-1c478899-0808-4e1f-ad8b-653b1b492a6f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:02.680294 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1c478899-0808-4e1f-ad8b-653b1b492a6f tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-volume_attachments/d100268f-2078-4b82-bcde-2126ccb89cca" status: 200 len: 194 microversion: 2.1 time: 0.044474 Dec 20 09:42:02.681042 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 786/1606] 10.222.0.62 () {58 vars in 1412 bytes} [Mon Dec 20 09:42:02 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-volume_attachments/d100268f-2078-4b82-bcde-2126ccb89cca => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:42:02.690353 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8c42e3de-f5bf-438d-adb3-c77fa30cfbc3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:02.690847 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-8c42e3de-f5bf-438d-adb3-c77fa30cfbc3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:42:02.697247 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8c42e3de-f5bf-438d-adb3-c77fa30cfbc3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:02.697696 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8c42e3de-f5bf-438d-adb3-c77fa30cfbc3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:02.698477 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8c42e3de-f5bf-438d-adb3-c77fa30cfbc3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:02.698911 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8c42e3de-f5bf-438d-adb3-c77fa30cfbc3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:02.779581 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.objects.instance [None req-8c42e3de-f5bf-438d-adb3-c77fa30cfbc3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lazy-loading 'services' on Instance uuid c2f7f56f-8489-4589-a846-970440886b36 {{(pid=116674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:42:03.004812 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8c42e3de-f5bf-438d-adb3-c77fa30cfbc3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-volume_attachments/d100268f-2078-4b82-bcde-2126ccb89cca" status: 202 len: 0 microversion: 2.1 time: 0.317849 Dec 20 09:42:03.005501 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 821/1607] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 20 09:42:02 2021] DELETE /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-volume_attachments/d100268f-2078-4b82-bcde-2126ccb89cca => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:42:05.185131 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9553f6ec-7d3f-4425-b41d-2efba76f89ba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:05.185782 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-9553f6ec-7d3f-4425-b41d-2efba76f89ba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:42:05.192532 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9553f6ec-7d3f-4425-b41d-2efba76f89ba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:05.193777 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9553f6ec-7d3f-4425-b41d-2efba76f89ba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:05.196254 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9553f6ec-7d3f-4425-b41d-2efba76f89ba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:05.196254 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-9553f6ec-7d3f-4425-b41d-2efba76f89ba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:05.226608 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9553f6ec-7d3f-4425-b41d-2efba76f89ba tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-volume_attachments/fe542c7f-8c38-4cc7-82e2-f7673f09e9e5" status: 200 len: 194 microversion: 2.1 time: 0.045182 Dec 20 09:42:05.227847 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 787/1608] 10.222.0.62 () {58 vars in 1412 bytes} [Mon Dec 20 09:42:05 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-volume_attachments/fe542c7f-8c38-4cc7-82e2-f7673f09e9e5 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:42:05.241242 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-61603620-5562-45e2-89d0-8b1fb919fbe7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:05.242396 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-61603620-5562-45e2-89d0-8b1fb919fbe7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:42:05.250377 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-61603620-5562-45e2-89d0-8b1fb919fbe7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:05.251017 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-61603620-5562-45e2-89d0-8b1fb919fbe7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:05.251900 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-61603620-5562-45e2-89d0-8b1fb919fbe7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:05.252340 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-61603620-5562-45e2-89d0-8b1fb919fbe7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:05.331157 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.objects.instance [None req-61603620-5562-45e2-89d0-8b1fb919fbe7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lazy-loading 'services' on Instance uuid c2f7f56f-8489-4589-a846-970440886b36 {{(pid=116674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:42:05.556925 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-61603620-5562-45e2-89d0-8b1fb919fbe7 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-volume_attachments/fe542c7f-8c38-4cc7-82e2-f7673f09e9e5" status: 202 len: 0 microversion: 2.1 time: 0.320805 Dec 20 09:42:05.557635 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 822/1609] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 20 09:42:05 2021] DELETE /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-volume_attachments/fe542c7f-8c38-4cc7-82e2-f7673f09e9e5 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:42:06.733997 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b506753b-2aa4-422c-a466-2a9916e141ed tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:06.736147 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b506753b-2aa4-422c-a466-2a9916e141ed tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:42:06.744534 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b506753b-2aa4-422c-a466-2a9916e141ed tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:06.745051 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b506753b-2aa4-422c-a466-2a9916e141ed tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:06.745896 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b506753b-2aa4-422c-a466-2a9916e141ed tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:06.746402 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b506753b-2aa4-422c-a466-2a9916e141ed tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:06.777608 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b506753b-2aa4-422c-a466-2a9916e141ed tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048105 Dec 20 09:42:06.778520 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 788/1610] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:42:06 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 20 09:42:06.891948 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-983dcdb0-eeda-47f0-ba04-0e23bc6c8c9b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:06.893098 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-983dcdb0-eeda-47f0-ba04-0e23bc6c8c9b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:42:06.900508 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-983dcdb0-eeda-47f0-ba04-0e23bc6c8c9b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:06.901050 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-983dcdb0-eeda-47f0-ba04-0e23bc6c8c9b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:06.901921 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-983dcdb0-eeda-47f0-ba04-0e23bc6c8c9b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:06.902427 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-983dcdb0-eeda-47f0-ba04-0e23bc6c8c9b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:06.941805 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-983dcdb0-eeda-47f0-ba04-0e23bc6c8c9b tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054477 Dec 20 09:42:06.945633 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 823/1611] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 20 09:42:06 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 20 09:42:07.003170 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4bac9d4f-b6e3-4872-b075-8516c234fc80 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:07.009131 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4bac9d4f-b6e3-4872-b075-8516c234fc80 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:42:07.011956 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4bac9d4f-b6e3-4872-b075-8516c234fc80 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:07.012490 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4bac9d4f-b6e3-4872-b075-8516c234fc80 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:07.013579 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4bac9d4f-b6e3-4872-b075-8516c234fc80 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:07.014015 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-4bac9d4f-b6e3-4872-b075-8516c234fc80 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:07.040138 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4bac9d4f-b6e3-4872-b075-8516c234fc80 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Going to try to terminate instance {{(pid=116675) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 09:42:07.274682 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4bac9d4f-b6e3-4872-b075-8516c234fc80 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36" status: 204 len: 0 microversion: 2.1 time: 0.274466 Dec 20 09:42:07.276593 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 789/1612] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 20 09:42:06 2021] DELETE /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 09:42:07.284895 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-aab2a28c-1335-4478-83cb-97fd8eddd07a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:07.285566 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-aab2a28c-1335-4478-83cb-97fd8eddd07a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:42:07.292855 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-aab2a28c-1335-4478-83cb-97fd8eddd07a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:07.293533 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-aab2a28c-1335-4478-83cb-97fd8eddd07a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:07.294327 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-aab2a28c-1335-4478-83cb-97fd8eddd07a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:07.294756 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-aab2a28c-1335-4478-83cb-97fd8eddd07a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:07.522356 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-aab2a28c-1335-4478-83cb-97fd8eddd07a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:42:07.530650 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-aab2a28c-1335-4478-83cb-97fd8eddd07a tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36" status: 200 len: 1674 microversion: 2.1 time: 0.249832 Dec 20 09:42:07.532004 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 824/1613] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:42:07 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36 => generated 1674 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:42:08.549579 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b54d20e1-158b-45fd-a00f-a668ffcdd6d4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:08.565031 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b54d20e1-158b-45fd-a00f-a668ffcdd6d4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:42:08.576247 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b54d20e1-158b-45fd-a00f-a668ffcdd6d4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:08.577044 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b54d20e1-158b-45fd-a00f-a668ffcdd6d4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:08.578027 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b54d20e1-158b-45fd-a00f-a668ffcdd6d4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:08.578472 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b54d20e1-158b-45fd-a00f-a668ffcdd6d4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:08.771757 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b54d20e1-158b-45fd-a00f-a668ffcdd6d4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:42:08.781052 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b54d20e1-158b-45fd-a00f-a668ffcdd6d4 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36" status: 200 len: 1674 microversion: 2.1 time: 0.236747 Dec 20 09:42:08.782192 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 790/1614] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:42:08 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36 => generated 1674 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:42:09.798485 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-12166dd2-d40a-4b06-b7fc-a66fbf478cf6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:09.800262 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-12166dd2-d40a-4b06-b7fc-a66fbf478cf6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:42:09.810533 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-12166dd2-d40a-4b06-b7fc-a66fbf478cf6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:09.816975 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-12166dd2-d40a-4b06-b7fc-a66fbf478cf6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:09.816975 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-12166dd2-d40a-4b06-b7fc-a66fbf478cf6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:09.816975 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-12166dd2-d40a-4b06-b7fc-a66fbf478cf6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:10.032181 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-12166dd2-d40a-4b06-b7fc-a66fbf478cf6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:42:10.040357 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-12166dd2-d40a-4b06-b7fc-a66fbf478cf6 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36" status: 200 len: 1674 microversion: 2.1 time: 0.245598 Dec 20 09:42:10.041154 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 825/1615] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:42:09 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36 => generated 1674 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:42:10.337369 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-86df18ba-5bde-43ce-9a83-b7304e9fcabb req-77b76467-e432-445b-a6e3-aefc17a08c23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2f7f56f-8489-4589-a846-970440886b36", "name": "network-vif-deleted", "tag": "feab4141-9fc1-4311-b05c-6745b26afc52"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:42:10.339998 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:42:10.339998 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:42:10.348283 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-86df18ba-5bde-43ce-9a83-b7304e9fcabb req-77b76467-e432-445b-a6e3-aefc17a08c23 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:10.349013 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-86df18ba-5bde-43ce-9a83-b7304e9fcabb req-77b76467-e432-445b-a6e3-aefc17a08c23 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:10.361558 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-86df18ba-5bde-43ce-9a83-b7304e9fcabb req-77b76467-e432-445b-a6e3-aefc17a08c23 service nova] Creating event network-vif-deleted:feab4141-9fc1-4311-b05c-6745b26afc52 for instance c2f7f56f-8489-4589-a846-970440886b36 on hv-cinder-81908 Dec 20 09:42:10.367242 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-86df18ba-5bde-43ce-9a83-b7304e9fcabb req-77b76467-e432-445b-a6e3-aefc17a08c23 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033743 Dec 20 09:42:10.368389 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 791/1616] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:42:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:42:11.057602 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-e3a77bc3-4869-44f9-bd36-20e24f6da77c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:11.060458 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-e3a77bc3-4869-44f9-bd36-20e24f6da77c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:42:11.067260 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e3a77bc3-4869-44f9-bd36-20e24f6da77c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:11.068016 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e3a77bc3-4869-44f9-bd36-20e24f6da77c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:11.069037 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e3a77bc3-4869-44f9-bd36-20e24f6da77c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:11.072363 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e3a77bc3-4869-44f9-bd36-20e24f6da77c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:11.112008 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e3a77bc3-4869-44f9-bd36-20e24f6da77c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:11.112008 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-e3a77bc3-4869-44f9-bd36-20e24f6da77c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:11.112008 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.objects.instance [None req-e3a77bc3-4869-44f9-bd36-20e24f6da77c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lazy-loading 'fault' on Instance uuid c2f7f56f-8489-4589-a846-970440886b36 {{(pid=116674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:42:11.153412 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-e3a77bc3-4869-44f9-bd36-20e24f6da77c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d81af5e27f434dba28295236ca39d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a528a79d2c4c94bd7b4a0b200b21f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:42:11.160665 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-e3a77bc3-4869-44f9-bd36-20e24f6da77c tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36" status: 200 len: 1328 microversion: 2.1 time: 0.107224 Dec 20 09:42:11.162117 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 826/1617] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:42:11 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36 => generated 1328 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:42:12.178465 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d4b3e8f8-a912-4a6b-bca8-042fa5ac3b79 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:12.179166 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d4b3e8f8-a912-4a6b-bca8-042fa5ac3b79 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:42:12.185574 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d4b3e8f8-a912-4a6b-bca8-042fa5ac3b79 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:12.186025 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d4b3e8f8-a912-4a6b-bca8-042fa5ac3b79 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:12.186801 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d4b3e8f8-a912-4a6b-bca8-042fa5ac3b79 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:12.187807 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d4b3e8f8-a912-4a6b-bca8-042fa5ac3b79 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:12.200384 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-d4b3e8f8-a912-4a6b-bca8-042fa5ac3b79 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] HTTP exception thrown: Instance c2f7f56f-8489-4589-a846-970440886b36 could not be found. Dec 20 09:42:12.200960 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d4b3e8f8-a912-4a6b-bca8-042fa5ac3b79 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Returning 404 to user: Instance c2f7f56f-8489-4589-a846-970440886b36 could not be found. {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:42:12.201763 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d4b3e8f8-a912-4a6b-bca8-042fa5ac3b79 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36" status: 404 len: 111 microversion: 2.1 time: 0.027286 Dec 20 09:42:12.202279 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 792/1618] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:42:12 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:42:12.211031 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-db9d188d-7d3e-4058-8157-baf92f679066 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '.version_select at 0x7f9153724790>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:12.341586 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-db9d188d-7d3e-4058-8157-baf92f679066 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2064850814" status: 202 len: 0 microversion: 2.1 time: 0.134749 Dec 20 09:42:12.342211 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 827/1619] 10.222.0.62 () {58 vars in 1220 bytes} [Mon Dec 20 09:42:12 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2064850814 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:42:15.775962 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-77ce719c-335e-42c2-bec8-000336668ec3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:15.777558 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-77ce719c-335e-42c2-bec8-000336668ec3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:42:15.791166 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-77ce719c-335e-42c2-bec8-000336668ec3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:15.792100 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-77ce719c-335e-42c2-bec8-000336668ec3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:15.793059 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-77ce719c-335e-42c2-bec8-000336668ec3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:15.793870 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-77ce719c-335e-42c2-bec8-000336668ec3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:15.809684 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-77ce719c-335e-42c2-bec8-000336668ec3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] HTTP exception thrown: Instance c2f7f56f-8489-4589-a846-970440886b36 could not be found. Dec 20 09:42:15.810279 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-77ce719c-335e-42c2-bec8-000336668ec3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Returning 404 to user: Instance c2f7f56f-8489-4589-a846-970440886b36 could not be found. {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:42:15.811112 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-77ce719c-335e-42c2-bec8-000336668ec3 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36" status: 404 len: 111 microversion: 2.1 time: 0.038965 Dec 20 09:42:15.811685 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 793/1620] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 20 09:42:15 2021] DELETE /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:42:15.821393 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-42afa9ef-da47-4668-8f07-572529da7707 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:15.821929 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-42afa9ef-da47-4668-8f07-572529da7707 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: c2f7f56f-8489-4589-a846-970440886b36] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:42:15.828497 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-42afa9ef-da47-4668-8f07-572529da7707 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:15.829173 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-42afa9ef-da47-4668-8f07-572529da7707 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:15.829978 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-42afa9ef-da47-4668-8f07-572529da7707 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:15.830360 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-42afa9ef-da47-4668-8f07-572529da7707 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:15.844513 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.wsgi [None req-42afa9ef-da47-4668-8f07-572529da7707 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] HTTP exception thrown: Instance c2f7f56f-8489-4589-a846-970440886b36 could not be found. Dec 20 09:42:15.845101 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-42afa9ef-da47-4668-8f07-572529da7707 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Returning 404 to user: Instance c2f7f56f-8489-4589-a846-970440886b36 could not be found. {{(pid=116674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:42:15.845992 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-42afa9ef-da47-4668-8f07-572529da7707 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36" status: 404 len: 111 microversion: 2.1 time: 0.029348 Dec 20 09:42:15.846864 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 828/1621] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:42:15 2021] GET /compute/v2.1/servers/c2f7f56f-8489-4589-a846-970440886b36 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:42:17.158577 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2b8a1455-a91a-49c0-b737-a8a85cd78f08 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:17.164394 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2b8a1455-a91a-49c0-b737-a8a85cd78f08 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:42:17.166282 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2b8a1455-a91a-49c0-b737-a8a85cd78f08 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:17.166731 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2b8a1455-a91a-49c0-b737-a8a85cd78f08 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:17.167504 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2b8a1455-a91a-49c0-b737-a8a85cd78f08 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:17.167966 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2b8a1455-a91a-49c0-b737-a8a85cd78f08 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:17.182436 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-2b8a1455-a91a-49c0-b737-a8a85cd78f08 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] HTTP exception thrown: Instance 1243c272-99f3-4606-9eb2-a4fe7cd30de7 could not be found. Dec 20 09:42:17.183025 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2b8a1455-a91a-49c0-b737-a8a85cd78f08 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Returning 404 to user: Instance 1243c272-99f3-4606-9eb2-a4fe7cd30de7 could not be found. {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:42:17.183872 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2b8a1455-a91a-49c0-b737-a8a85cd78f08 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 404 len: 111 microversion: 2.1 time: 0.028926 Dec 20 09:42:17.184416 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 794/1622] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 20 09:42:17 2021] DELETE /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:42:17.192766 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c650d601-f111-49a7-abf3-184cb9602964 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:17.193441 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-c650d601-f111-49a7-abf3-184cb9602964 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] [instance: 1243c272-99f3-4606-9eb2-a4fe7cd30de7] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:42:17.199967 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c650d601-f111-49a7-abf3-184cb9602964 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:17.200419 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c650d601-f111-49a7-abf3-184cb9602964 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:17.201204 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c650d601-f111-49a7-abf3-184cb9602964 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:17.201643 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-c650d601-f111-49a7-abf3-184cb9602964 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:17.216411 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.wsgi [None req-c650d601-f111-49a7-abf3-184cb9602964 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] HTTP exception thrown: Instance 1243c272-99f3-4606-9eb2-a4fe7cd30de7 could not be found. Dec 20 09:42:17.217012 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c650d601-f111-49a7-abf3-184cb9602964 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] Returning 404 to user: Instance 1243c272-99f3-4606-9eb2-a4fe7cd30de7 could not be found. {{(pid=116674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:42:17.217844 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c650d601-f111-49a7-abf3-184cb9602964 tempest-AttachVolumeTestJSON-1899511046 tempest-AttachVolumeTestJSON-1899511046-project] 10.222.0.62 "GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7" status: 404 len: 111 microversion: 2.1 time: 0.029372 Dec 20 09:42:17.218399 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 829/1623] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:42:17 2021] GET /compute/v2.1/servers/1243c272-99f3-4606-9eb2-a4fe7cd30de7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 20 09:42:25.311206 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-bed6191c-3f7c-4a0f-8794-74d08da9768e tempest-VolumesGetTestJSON-1424742593 tempest-VolumesGetTestJSON-1424742593-project] Action: 'create', calling method: .version_select at 0x7f914f2d9040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-329040685", "metadata": {"Type": "work"}}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:42:26.034110 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-bed6191c-3f7c-4a0f-8794-74d08da9768e tempest-VolumesGetTestJSON-1424742593 tempest-VolumesGetTestJSON-1424742593-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.855557 Dec 20 09:42:26.035101 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 795/1624] 10.222.0.62 () {60 vars in 1155 bytes} [Mon Dec 20 09:42:25 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 857 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 20 09:42:26.046869 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-86b846b9-30e8-41fa-84e0-1d2626c3e8c1 tempest-VolumesGetTestJSON-1424742593 tempest-VolumesGetTestJSON-1424742593-project] Calling method '.version_select at 0x7f915378c4c0>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:26.106323 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-86b846b9-30e8-41fa-84e0-1d2626c3e8c1 tempest-VolumesGetTestJSON-1424742593 tempest-VolumesGetTestJSON-1424742593-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/0ac16964-bfd2-4e9a-9ff5-fb866b34afb3" status: 200 len: 352 microversion: 2.1 time: 0.064225 Dec 20 09:42:26.106892 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 830/1625] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 20 09:42:26 2021] GET /compute/v2.1/os-volumes/0ac16964-bfd2-4e9a-9ff5-fb866b34afb3 => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:42:26.616613 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b2b61e50-522b-485e-8f38-3a9b1632b050 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Action: 'create', calling method: .version_select at 0x7f914f4dfdc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2061179994"}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:42:26.640078 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-b2b61e50-522b-485e-8f38-3a9b1632b050 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Getting quotas for project 55caff02fd494487955d97e9c4a5f9f6. Resources: {'key_pairs'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:42:26.644164 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-b2b61e50-522b-485e-8f38-3a9b1632b050 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Getting quotas for user 9f0bad80facd40ae8187b4c192c40ede and project 55caff02fd494487955d97e9c4a5f9f6. Resources: {'key_pairs'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:42:26.963324 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-b2b61e50-522b-485e-8f38-3a9b1632b050 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Getting quotas for project 55caff02fd494487955d97e9c4a5f9f6. Resources: {'key_pairs'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:42:26.967028 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-b2b61e50-522b-485e-8f38-3a9b1632b050 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Getting quotas for user 9f0bad80facd40ae8187b4c192c40ede and project 55caff02fd494487955d97e9c4a5f9f6. Resources: {'key_pairs'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:42:26.980612 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b2b61e50-522b-485e-8f38-3a9b1632b050 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.482865 Dec 20 09:42:26.981214 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 796/1626] 10.222.0.62 () {60 vars in 1157 bytes} [Mon Dec 20 09:42:26 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:42:27.118559 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-627a7ed1-73a8-4d70-8847-75c2de2745b9 tempest-VolumesGetTestJSON-1424742593 tempest-VolumesGetTestJSON-1424742593-project] Calling method '.version_select at 0x7f91537298b0>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:27.166493 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-627a7ed1-73a8-4d70-8847-75c2de2745b9 tempest-VolumesGetTestJSON-1424742593 tempest-VolumesGetTestJSON-1424742593-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/0ac16964-bfd2-4e9a-9ff5-fb866b34afb3" status: 200 len: 352 microversion: 2.1 time: 0.052006 Dec 20 09:42:27.167076 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 831/1627] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 20 09:42:27 2021] GET /compute/v2.1/os-volumes/0ac16964-bfd2-4e9a-9ff5-fb866b34afb3 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:42:28.178847 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-3d353e1c-2e33-4bd9-b22c-064f22c3ba65 tempest-VolumesGetTestJSON-1424742593 tempest-VolumesGetTestJSON-1424742593-project] Calling method '.version_select at 0x7f914f494160>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:28.228024 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-3d353e1c-2e33-4bd9-b22c-064f22c3ba65 tempest-VolumesGetTestJSON-1424742593 tempest-VolumesGetTestJSON-1424742593-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/0ac16964-bfd2-4e9a-9ff5-fb866b34afb3" status: 200 len: 352 microversion: 2.1 time: 0.053439 Dec 20 09:42:28.228778 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 797/1628] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 20 09:42:28 2021] GET /compute/v2.1/os-volumes/0ac16964-bfd2-4e9a-9ff5-fb866b34afb3 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:42:29.245991 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b2c554f8-5ed0-438e-a14a-65bbec825d0e tempest-VolumesGetTestJSON-1424742593 tempest-VolumesGetTestJSON-1424742593-project] Calling method '.version_select at 0x7f9153724700>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:29.286434 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b2c554f8-5ed0-438e-a14a-65bbec825d0e tempest-VolumesGetTestJSON-1424742593 tempest-VolumesGetTestJSON-1424742593-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/0ac16964-bfd2-4e9a-9ff5-fb866b34afb3" status: 200 len: 353 microversion: 2.1 time: 0.049696 Dec 20 09:42:29.287004 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 832/1629] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 20 09:42:29 2021] GET /compute/v2.1/os-volumes/0ac16964-bfd2-4e9a-9ff5-fb866b34afb3 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:42:29.298099 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2dc27624-9ac1-4a5b-938c-3c2c9133e6c3 tempest-VolumesGetTestJSON-1424742593 tempest-VolumesGetTestJSON-1424742593-project] Calling method '.version_select at 0x7f915392b790>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:29.356928 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2dc27624-9ac1-4a5b-938c-3c2c9133e6c3 tempest-VolumesGetTestJSON-1424742593 tempest-VolumesGetTestJSON-1424742593-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/0ac16964-bfd2-4e9a-9ff5-fb866b34afb3" status: 200 len: 353 microversion: 2.1 time: 0.062886 Dec 20 09:42:29.358043 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 798/1630] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 20 09:42:29 2021] GET /compute/v2.1/os-volumes/0ac16964-bfd2-4e9a-9ff5-fb866b34afb3 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:42:29.370742 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-bc6b61a5-bcd4-4c02-a309-761ff4d47259 tempest-VolumesGetTestJSON-1424742593 tempest-VolumesGetTestJSON-1424742593-project] Calling method '.version_select at 0x7f914e42ae50>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:29.622747 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-bc6b61a5-bcd4-4c02-a309-761ff4d47259 tempest-VolumesGetTestJSON-1424742593 tempest-VolumesGetTestJSON-1424742593-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/0ac16964-bfd2-4e9a-9ff5-fb866b34afb3" status: 202 len: 0 microversion: 2.1 time: 0.256118 Dec 20 09:42:29.623750 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 833/1631] 10.222.0.62 () {58 vars in 1247 bytes} [Mon Dec 20 09:42:29 2021] DELETE /compute/v2.1/os-volumes/0ac16964-bfd2-4e9a-9ff5-fb866b34afb3 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:42:29.632743 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-bb962d4b-1e80-4772-b3b0-0b54355394d1 tempest-VolumesGetTestJSON-1424742593 tempest-VolumesGetTestJSON-1424742593-project] Calling method '.version_select at 0x7f91538e21f0>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:29.826076 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-bb962d4b-1e80-4772-b3b0-0b54355394d1 tempest-VolumesGetTestJSON-1424742593 tempest-VolumesGetTestJSON-1424742593-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/0ac16964-bfd2-4e9a-9ff5-fb866b34afb3" status: 200 len: 352 microversion: 2.1 time: 0.197967 Dec 20 09:42:29.827138 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 799/1632] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 20 09:42:29 2021] GET /compute/v2.1/os-volumes/0ac16964-bfd2-4e9a-9ff5-fb866b34afb3 => generated 352 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:42:30.839000 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-80ca72d0-e633-4e6b-9567-4e26b17f6453 tempest-VolumesGetTestJSON-1424742593 tempest-VolumesGetTestJSON-1424742593-project] Calling method '.version_select at 0x7f9153795820>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:30.874392 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.wsgi [None req-80ca72d0-e633-4e6b-9567-4e26b17f6453 tempest-VolumesGetTestJSON-1424742593 tempest-VolumesGetTestJSON-1424742593-project] HTTP exception thrown: Volume 0ac16964-bfd2-4e9a-9ff5-fb866b34afb3 could not be found. Dec 20 09:42:30.875008 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-80ca72d0-e633-4e6b-9567-4e26b17f6453 tempest-VolumesGetTestJSON-1424742593 tempest-VolumesGetTestJSON-1424742593-project] Returning 404 to user: Volume 0ac16964-bfd2-4e9a-9ff5-fb866b34afb3 could not be found. {{(pid=116674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:42:30.876115 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-80ca72d0-e633-4e6b-9567-4e26b17f6453 tempest-VolumesGetTestJSON-1424742593 tempest-VolumesGetTestJSON-1424742593-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/0ac16964-bfd2-4e9a-9ff5-fb866b34afb3" status: 404 len: 109 microversion: 2.1 time: 0.040993 Dec 20 09:42:30.876957 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 834/1633] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 20 09:42:30 2021] GET /compute/v2.1/os-volumes/0ac16964-bfd2-4e9a-9ff5-fb866b34afb3 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:42:33.047607 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a8f54a4b-19e9-4dca-8527-94d346e3d8bc tempest-VolumesNegativeTest-1903102776 tempest-VolumesNegativeTest-1903102776-project] Action: 'create', calling method: .version_select at 0x7f914f2b7a60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-491841438", "metadata": {"Type": "work"}}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:42:33.050296 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a8f54a4b-19e9-4dca-8527-94d346e3d8bc tempest-VolumesNegativeTest-1903102776 tempest-VolumesNegativeTest-1903102776-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:42:33.051149 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a8f54a4b-19e9-4dca-8527-94d346e3d8bc tempest-VolumesNegativeTest-1903102776 tempest-VolumesNegativeTest-1903102776-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.123557 Dec 20 09:42:33.051690 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 800/1634] 10.222.0.62 () {60 vars in 1155 bytes} [Mon Dec 20 09:42:32 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 20 09:42:33.061185 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c4426ffc-13da-4a36-9892-19a00499ed8d tempest-VolumesNegativeTest-1903102776 tempest-VolumesNegativeTest-1903102776-project] Action: 'create', calling method: .version_select at 0x7f915388c040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-871292889", "metadata": {"Type": "work"}}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:42:33.062700 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-c4426ffc-13da-4a36-9892-19a00499ed8d tempest-VolumesNegativeTest-1903102776 tempest-VolumesNegativeTest-1903102776-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:42:33.063473 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-c4426ffc-13da-4a36-9892-19a00499ed8d tempest-VolumesNegativeTest-1903102776 tempest-VolumesNegativeTest-1903102776-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006439 Dec 20 09:42:33.064094 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 835/1635] 10.222.0.62 () {60 vars in 1155 bytes} [Mon Dec 20 09:42:33 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 20 09:42:33.072701 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1215ca70-24c0-49bc-a899-c34958302c70 tempest-VolumesNegativeTest-1903102776 tempest-VolumesNegativeTest-1903102776-project] Action: 'create', calling method: .version_select at 0x7f914f213310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1881414995", "metadata": {"Type": "work"}}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:42:33.074323 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-1215ca70-24c0-49bc-a899-c34958302c70 tempest-VolumesNegativeTest-1903102776 tempest-VolumesNegativeTest-1903102776-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:42:33.075103 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-1215ca70-24c0-49bc-a899-c34958302c70 tempest-VolumesNegativeTest-1903102776 tempest-VolumesNegativeTest-1903102776-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005987 Dec 20 09:42:33.075600 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 801/1636] 10.222.0.62 () {60 vars in 1155 bytes} [Mon Dec 20 09:42:33 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 20 09:42:33.084114 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a3d889c8-1b1f-48db-9472-ca095db74b10 tempest-VolumesNegativeTest-1903102776 tempest-VolumesNegativeTest-1903102776-project] Calling method '.version_select at 0x7f91538210d0>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:33.113474 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.wsgi [None req-a3d889c8-1b1f-48db-9472-ca095db74b10 tempest-VolumesNegativeTest-1903102776 tempest-VolumesNegativeTest-1903102776-project] HTTP exception thrown: Volume tempest-invalid-2123426871 could not be found. Dec 20 09:42:33.114114 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-a3d889c8-1b1f-48db-9472-ca095db74b10 tempest-VolumesNegativeTest-1903102776 tempest-VolumesNegativeTest-1903102776-project] Returning 404 to user: Volume tempest-invalid-2123426871 could not be found. {{(pid=116674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:42:33.114952 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-a3d889c8-1b1f-48db-9472-ca095db74b10 tempest-VolumesNegativeTest-1903102776 tempest-VolumesNegativeTest-1903102776-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2123426871" status: 404 len: 99 microversion: 2.1 time: 0.034819 Dec 20 09:42:33.116376 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 836/1637] 10.222.0.62 () {58 vars in 1217 bytes} [Mon Dec 20 09:42:33 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-2123426871 => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 20 09:42:33.126581 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-17cd917a-7929-4a2b-8caf-75d99ec99112 tempest-VolumesNegativeTest-1903102776 tempest-VolumesNegativeTest-1903102776-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003822 Dec 20 09:42:33.133746 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 802/1638] 10.222.0.62 () {58 vars in 1139 bytes} [Mon Dec 20 09:42:33 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 20 09:42:33.141990 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-6d1c2c66-2586-4bfb-96a1-95308e945082 tempest-VolumesNegativeTest-1903102776 tempest-VolumesNegativeTest-1903102776-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003520 Dec 20 09:42:33.153127 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9a2d5acf-054b-4b19-8266-3f1ef59e23c0 tempest-VolumesNegativeTest-1903102776 tempest-VolumesNegativeTest-1903102776-project] Calling method '.version_select at 0x7f91538e5040>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:33.159897 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 837/1639] 10.222.0.62 () {58 vars in 1136 bytes} [Mon Dec 20 09:42:33 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 20 09:42:33.185133 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-9a2d5acf-054b-4b19-8266-3f1ef59e23c0 tempest-VolumesNegativeTest-1903102776 tempest-VolumesNegativeTest-1903102776-project] HTTP exception thrown: Volume c2b64a5a-12a0-4aca-aaca-b4e5d3434a23 could not be found. Dec 20 09:42:33.185133 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-9a2d5acf-054b-4b19-8266-3f1ef59e23c0 tempest-VolumesNegativeTest-1903102776 tempest-VolumesNegativeTest-1903102776-project] Returning 404 to user: Volume c2b64a5a-12a0-4aca-aaca-b4e5d3434a23 could not be found. {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:42:33.185133 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-9a2d5acf-054b-4b19-8266-3f1ef59e23c0 tempest-VolumesNegativeTest-1903102776 tempest-VolumesNegativeTest-1903102776-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/c2b64a5a-12a0-4aca-aaca-b4e5d3434a23" status: 404 len: 109 microversion: 2.1 time: 0.035404 Dec 20 09:42:33.187059 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 803/1640] 10.222.0.62 () {58 vars in 1247 bytes} [Mon Dec 20 09:42:33 2021] DELETE /compute/v2.1/os-volumes/c2b64a5a-12a0-4aca-aaca-b4e5d3434a23 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:42:33.194576 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4d5004b3-b8e7-408d-afba-f24fc5942890 tempest-VolumesNegativeTest-1903102776 tempest-VolumesNegativeTest-1903102776-project] Calling method '.version_select at 0x7f914e47a790>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:33.221416 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.wsgi [None req-4d5004b3-b8e7-408d-afba-f24fc5942890 tempest-VolumesNegativeTest-1903102776 tempest-VolumesNegativeTest-1903102776-project] HTTP exception thrown: Volume 25eb37b3-25dc-49de-98b4-48e48c4f7599 could not be found. Dec 20 09:42:33.222051 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-4d5004b3-b8e7-408d-afba-f24fc5942890 tempest-VolumesNegativeTest-1903102776 tempest-VolumesNegativeTest-1903102776-project] Returning 404 to user: Volume 25eb37b3-25dc-49de-98b4-48e48c4f7599 could not be found. {{(pid=116674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:42:33.222922 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-4d5004b3-b8e7-408d-afba-f24fc5942890 tempest-VolumesNegativeTest-1903102776 tempest-VolumesNegativeTest-1903102776-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/25eb37b3-25dc-49de-98b4-48e48c4f7599" status: 404 len: 109 microversion: 2.1 time: 0.032577 Dec 20 09:42:33.223479 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 838/1641] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 20 09:42:33 2021] GET /compute/v2.1/os-volumes/25eb37b3-25dc-49de-98b4-48e48c4f7599 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:42:53.604548 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2f429cdc-3bbf-4e8b-bcab-8d635e2109b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-232622756", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2061179994", "security_groups": [{"name": "tempest-secgroup-smoke-1114357505"}], "block_device_mapping_v2": [{"uuid": "e49774c1-96d1-4855-8a29-683da3709098", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "55b3223d-d4ab-4041-8d10-5ec0548f2a32"}]}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:42:53.713663 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.network.neutron [None req-2f429cdc-3bbf-4e8b-bcab-8d635e2109b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] validate_networks() for [('55b3223d-d4ab-4041-8d10-5ec0548f2a32', None, None, None, None, None)] {{(pid=116675) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 09:42:54.073860 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-2f429cdc-3bbf-4e8b-bcab-8d635e2109b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Flavor limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 09:42:54.074287 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-2f429cdc-3bbf-4e8b-bcab-8d635e2109b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Image limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 09:42:54.074760 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-2f429cdc-3bbf-4e8b-bcab-8d635e2109b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Flavor pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 09:42:54.075175 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-2f429cdc-3bbf-4e8b-bcab-8d635e2109b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Image pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 09:42:54.075620 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-2f429cdc-3bbf-4e8b-bcab-8d635e2109b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 09:42:54.084180 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2f429cdc-3bbf-4e8b-bcab-8d635e2109b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:54.084625 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2f429cdc-3bbf-4e8b-bcab-8d635e2109b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:54.085444 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2f429cdc-3bbf-4e8b-bcab-8d635e2109b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:54.085910 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2f429cdc-3bbf-4e8b-bcab-8d635e2109b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:54.102774 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-2f429cdc-3bbf-4e8b-bcab-8d635e2109b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Getting quotas for project 55caff02fd494487955d97e9c4a5f9f6. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:42:54.106930 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-2f429cdc-3bbf-4e8b-bcab-8d635e2109b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Getting quotas for user 9f0bad80facd40ae8187b4c192c40ede and project 55caff02fd494487955d97e9c4a5f9f6. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:42:54.159715 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2f429cdc-3bbf-4e8b-bcab-8d635e2109b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Going to run 1 instances... {{(pid=116675) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 09:42:54.161826 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2f429cdc-3bbf-4e8b-bcab-8d635e2109b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e49774c1-96d1-4855-8a29-683da3709098',volume_size=None,volume_type=None)] {{(pid=116675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 09:42:54.517239 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2f429cdc-3bbf-4e8b-bcab-8d635e2109b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.917660 Dec 20 09:42:54.517890 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 804/1642] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 20 09:42:53 2021] POST /compute/v2.1/servers => generated 406 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 20 09:42:54.530827 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3ff5a36f-7093-4b44-a240-747281259b59 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:54.531443 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-3ff5a36f-7093-4b44-a240-747281259b59 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:42:54.587142 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3ff5a36f-7093-4b44-a240-747281259b59 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:42:54.593593 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3ff5a36f-7093-4b44-a240-747281259b59 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 200 len: 1094 microversion: 2.1 time: 0.069185 Dec 20 09:42:54.594170 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 839/1643] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:42:54 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:42:55.611338 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6b0f39b9-f326-4a7a-be96-dbbd49815b66 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:55.611918 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6b0f39b9-f326-4a7a-be96-dbbd49815b66 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:42:55.617902 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6b0f39b9-f326-4a7a-be96-dbbd49815b66 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:55.623438 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6b0f39b9-f326-4a7a-be96-dbbd49815b66 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:55.623438 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6b0f39b9-f326-4a7a-be96-dbbd49815b66 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:55.623438 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6b0f39b9-f326-4a7a-be96-dbbd49815b66 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:55.679715 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-6b0f39b9-f326-4a7a-be96-dbbd49815b66 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:42:55.686935 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6b0f39b9-f326-4a7a-be96-dbbd49815b66 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 200 len: 1144 microversion: 2.1 time: 0.080227 Dec 20 09:42:55.687488 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 805/1644] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:42:55 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:42:56.703569 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-530d9c7e-7b99-4877-8b2f-1026aa533aae tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:56.704214 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-530d9c7e-7b99-4877-8b2f-1026aa533aae tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:42:56.710686 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-530d9c7e-7b99-4877-8b2f-1026aa533aae tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:56.715888 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-530d9c7e-7b99-4877-8b2f-1026aa533aae tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:56.715888 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-530d9c7e-7b99-4877-8b2f-1026aa533aae tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:56.715888 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-530d9c7e-7b99-4877-8b2f-1026aa533aae tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:56.775994 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-530d9c7e-7b99-4877-8b2f-1026aa533aae tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:42:56.784164 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-530d9c7e-7b99-4877-8b2f-1026aa533aae tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 200 len: 1200 microversion: 2.1 time: 0.084281 Dec 20 09:42:56.785000 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 840/1645] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:42:56 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 1200 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:42:57.800503 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-664e85c6-0f4b-45fe-b06c-d61170b38e17 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:57.801123 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-664e85c6-0f4b-45fe-b06c-d61170b38e17 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:42:57.808065 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-664e85c6-0f4b-45fe-b06c-d61170b38e17 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:57.808518 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-664e85c6-0f4b-45fe-b06c-d61170b38e17 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:57.809298 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-664e85c6-0f4b-45fe-b06c-d61170b38e17 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:57.809769 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-664e85c6-0f4b-45fe-b06c-d61170b38e17 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:57.955042 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-664e85c6-0f4b-45fe-b06c-d61170b38e17 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:42:57.963106 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-664e85c6-0f4b-45fe-b06c-d61170b38e17 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 200 len: 1278 microversion: 2.1 time: 0.166132 Dec 20 09:42:57.964066 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 806/1646] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:42:57 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:42:58.205850 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-b08de651-8731-4721-a5ab-d34eaa2e5b51 req-45bee88f-0366-4a5f-807e-91705063487c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a4b0d6-febf-488e-978d-8f4c2b4102d5", "tag": "63703bb7-df45-4534-8913-765870d1ec6a"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:42:58.209480 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:42:58.209480 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:42:58.220152 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-b08de651-8731-4721-a5ab-d34eaa2e5b51 req-45bee88f-0366-4a5f-807e-91705063487c service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:58.221781 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-b08de651-8731-4721-a5ab-d34eaa2e5b51 req-45bee88f-0366-4a5f-807e-91705063487c service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:58.234461 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-b08de651-8731-4721-a5ab-d34eaa2e5b51 req-45bee88f-0366-4a5f-807e-91705063487c service nova] Creating event network-changed:63703bb7-df45-4534-8913-765870d1ec6a for instance a2a4b0d6-febf-488e-978d-8f4c2b4102d5 on hv-cinder-81908 Dec 20 09:42:58.239632 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-b08de651-8731-4721-a5ab-d34eaa2e5b51 req-45bee88f-0366-4a5f-807e-91705063487c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039890 Dec 20 09:42:58.240292 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 841/1647] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:42:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:42:58.980908 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-22091c40-52e4-44c0-800a-efc885aaf585 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:42:58.981871 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-22091c40-52e4-44c0-800a-efc885aaf585 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:42:58.988221 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-22091c40-52e4-44c0-800a-efc885aaf585 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:58.988669 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-22091c40-52e4-44c0-800a-efc885aaf585 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:58.989435 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-22091c40-52e4-44c0-800a-efc885aaf585 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:42:58.989865 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-22091c40-52e4-44c0-800a-efc885aaf585 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:42:59.122198 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-22091c40-52e4-44c0-800a-efc885aaf585 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:42:59.129414 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-22091c40-52e4-44c0-800a-efc885aaf585 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 200 len: 1266 microversion: 2.1 time: 0.152826 Dec 20 09:42:59.130347 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 807/1648] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:42:58 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:43:00.147179 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d9de2a33-03cb-4cc4-8328-878dc319db25 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:43:00.147897 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d9de2a33-03cb-4cc4-8328-878dc319db25 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:43:00.154697 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d9de2a33-03cb-4cc4-8328-878dc319db25 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:00.155181 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d9de2a33-03cb-4cc4-8328-878dc319db25 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:00.155995 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d9de2a33-03cb-4cc4-8328-878dc319db25 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:00.156433 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d9de2a33-03cb-4cc4-8328-878dc319db25 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:00.289343 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d9de2a33-03cb-4cc4-8328-878dc319db25 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:43:00.296475 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d9de2a33-03cb-4cc4-8328-878dc319db25 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 200 len: 1266 microversion: 2.1 time: 0.153797 Dec 20 09:43:00.297031 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 842/1649] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:43:00 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:43:01.313390 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0ac3a0db-419f-4391-bca6-cc71b4de45d1 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:43:01.314036 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0ac3a0db-419f-4391-bca6-cc71b4de45d1 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:43:01.320959 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0ac3a0db-419f-4391-bca6-cc71b4de45d1 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:01.321409 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0ac3a0db-419f-4391-bca6-cc71b4de45d1 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:01.322184 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0ac3a0db-419f-4391-bca6-cc71b4de45d1 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:01.322622 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0ac3a0db-419f-4391-bca6-cc71b4de45d1 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:01.456968 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-0ac3a0db-419f-4391-bca6-cc71b4de45d1 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:43:01.464245 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0ac3a0db-419f-4391-bca6-cc71b4de45d1 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 200 len: 1266 microversion: 2.1 time: 0.154567 Dec 20 09:43:01.464815 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 808/1650] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:43:01 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:43:02.481020 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d1d72ecd-ba5c-4904-8065-2b8ebf8fe816 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:43:02.482021 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d1d72ecd-ba5c-4904-8065-2b8ebf8fe816 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:43:02.488191 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d1d72ecd-ba5c-4904-8065-2b8ebf8fe816 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:02.488643 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d1d72ecd-ba5c-4904-8065-2b8ebf8fe816 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:02.489419 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d1d72ecd-ba5c-4904-8065-2b8ebf8fe816 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:02.489853 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d1d72ecd-ba5c-4904-8065-2b8ebf8fe816 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:02.620152 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-d1d72ecd-ba5c-4904-8065-2b8ebf8fe816 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:43:02.627433 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d1d72ecd-ba5c-4904-8065-2b8ebf8fe816 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 200 len: 1266 microversion: 2.1 time: 0.150064 Dec 20 09:43:02.628025 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 843/1651] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:43:02 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:43:03.643827 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-bea65cee-202c-43df-adf5-d0a901bd08d0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:43:03.644475 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-bea65cee-202c-43df-adf5-d0a901bd08d0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:43:03.650743 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bea65cee-202c-43df-adf5-d0a901bd08d0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:03.651197 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bea65cee-202c-43df-adf5-d0a901bd08d0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:03.652000 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bea65cee-202c-43df-adf5-d0a901bd08d0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:03.652442 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-bea65cee-202c-43df-adf5-d0a901bd08d0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:03.780104 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-bea65cee-202c-43df-adf5-d0a901bd08d0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:43:03.787302 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-bea65cee-202c-43df-adf5-d0a901bd08d0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 200 len: 1266 microversion: 2.1 time: 0.147165 Dec 20 09:43:03.787903 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 809/1652] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:43:03 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:43:04.804722 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f70953e3-f404-42fe-b65a-f9fc065b70c5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:43:04.805262 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f70953e3-f404-42fe-b65a-f9fc065b70c5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:43:04.813417 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f70953e3-f404-42fe-b65a-f9fc065b70c5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:04.813859 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f70953e3-f404-42fe-b65a-f9fc065b70c5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:04.814644 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f70953e3-f404-42fe-b65a-f9fc065b70c5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:04.815079 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f70953e3-f404-42fe-b65a-f9fc065b70c5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:04.946706 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-f70953e3-f404-42fe-b65a-f9fc065b70c5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:43:04.953889 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f70953e3-f404-42fe-b65a-f9fc065b70c5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 200 len: 1266 microversion: 2.1 time: 0.153403 Dec 20 09:43:04.958780 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 844/1653] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:43:04 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:43:05.970185 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-fac49e3c-488b-4ede-b58d-e81f6abc04d4 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:43:05.971176 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-fac49e3c-488b-4ede-b58d-e81f6abc04d4 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:43:05.977261 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fac49e3c-488b-4ede-b58d-e81f6abc04d4 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:05.977708 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fac49e3c-488b-4ede-b58d-e81f6abc04d4 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:05.978541 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fac49e3c-488b-4ede-b58d-e81f6abc04d4 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:05.978974 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fac49e3c-488b-4ede-b58d-e81f6abc04d4 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:06.107367 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-fac49e3c-488b-4ede-b58d-e81f6abc04d4 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:43:06.114629 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-fac49e3c-488b-4ede-b58d-e81f6abc04d4 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 200 len: 1266 microversion: 2.1 time: 0.148189 Dec 20 09:43:06.115192 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 810/1654] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:43:05 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:43:07.131822 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-ef229c8a-6fb7-4216-9f8c-76976aa9dc43 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:43:07.133038 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-ef229c8a-6fb7-4216-9f8c-76976aa9dc43 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:43:07.139344 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ef229c8a-6fb7-4216-9f8c-76976aa9dc43 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:07.139828 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ef229c8a-6fb7-4216-9f8c-76976aa9dc43 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:07.140604 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ef229c8a-6fb7-4216-9f8c-76976aa9dc43 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:07.141039 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-ef229c8a-6fb7-4216-9f8c-76976aa9dc43 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:07.278059 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-ef229c8a-6fb7-4216-9f8c-76976aa9dc43 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:43:07.285273 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-ef229c8a-6fb7-4216-9f8c-76976aa9dc43 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 200 len: 1266 microversion: 2.1 time: 0.157150 Dec 20 09:43:07.285843 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 845/1655] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:43:07 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:43:08.301578 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-fa6db10b-16c6-4247-ad45-c6371458489c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:43:08.302116 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-fa6db10b-16c6-4247-ad45-c6371458489c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:43:08.309180 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fa6db10b-16c6-4247-ad45-c6371458489c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:08.309622 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fa6db10b-16c6-4247-ad45-c6371458489c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:08.310379 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fa6db10b-16c6-4247-ad45-c6371458489c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:08.310807 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-fa6db10b-16c6-4247-ad45-c6371458489c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:08.440670 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-fa6db10b-16c6-4247-ad45-c6371458489c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:43:08.448125 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-fa6db10b-16c6-4247-ad45-c6371458489c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 200 len: 1266 microversion: 2.1 time: 0.150251 Dec 20 09:43:08.448695 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 811/1656] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:43:08 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:43:09.465231 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-98966ad2-f9cb-48f5-9d28-6810ff521e44 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:43:09.465844 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-98966ad2-f9cb-48f5-9d28-6810ff521e44 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:43:09.471837 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-98966ad2-f9cb-48f5-9d28-6810ff521e44 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:09.472293 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-98966ad2-f9cb-48f5-9d28-6810ff521e44 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:09.473072 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-98966ad2-f9cb-48f5-9d28-6810ff521e44 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:09.473508 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-98966ad2-f9cb-48f5-9d28-6810ff521e44 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:09.605210 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-98966ad2-f9cb-48f5-9d28-6810ff521e44 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:43:09.612811 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-98966ad2-f9cb-48f5-9d28-6810ff521e44 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 200 len: 1266 microversion: 2.1 time: 0.151398 Dec 20 09:43:09.613370 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 846/1657] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:43:09 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:43:10.203047 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-c946e502-7222-440b-a711-f408fad5369d req-539e5f52-0173-4f72-8384-6c52d6e4937b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a4b0d6-febf-488e-978d-8f4c2b4102d5", "name": "network-vif-plugged", "status": "completed", "tag": "63703bb7-df45-4534-8913-765870d1ec6a"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:43:10.204673 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:43:10.204673 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:43:10.211971 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-c946e502-7222-440b-a711-f408fad5369d req-539e5f52-0173-4f72-8384-6c52d6e4937b service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:10.212416 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-c946e502-7222-440b-a711-f408fad5369d req-539e5f52-0173-4f72-8384-6c52d6e4937b service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:10.222943 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-c946e502-7222-440b-a711-f408fad5369d req-539e5f52-0173-4f72-8384-6c52d6e4937b service nova] Creating event network-vif-plugged:63703bb7-df45-4534-8913-765870d1ec6a for instance a2a4b0d6-febf-488e-978d-8f4c2b4102d5 on hv-cinder-81908 Dec 20 09:43:10.228538 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-c946e502-7222-440b-a711-f408fad5369d req-539e5f52-0173-4f72-8384-6c52d6e4937b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029096 Dec 20 09:43:10.229119 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 812/1658] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:43:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:43:10.629806 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b5560e84-31b4-4e02-8ce1-c1bfde37d0ab tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:43:10.630413 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b5560e84-31b4-4e02-8ce1-c1bfde37d0ab tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:43:10.637469 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b5560e84-31b4-4e02-8ce1-c1bfde37d0ab tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:10.637918 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b5560e84-31b4-4e02-8ce1-c1bfde37d0ab tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:10.638707 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b5560e84-31b4-4e02-8ce1-c1bfde37d0ab tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:10.639145 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b5560e84-31b4-4e02-8ce1-c1bfde37d0ab tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:10.769645 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b5560e84-31b4-4e02-8ce1-c1bfde37d0ab tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:43:10.777523 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b5560e84-31b4-4e02-8ce1-c1bfde37d0ab tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 200 len: 1266 microversion: 2.1 time: 0.151403 Dec 20 09:43:10.778094 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 847/1659] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:43:10 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:43:11.795363 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-96a00102-719e-4013-8275-ca5fbd88d113 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:43:11.796084 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-96a00102-719e-4013-8275-ca5fbd88d113 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:43:11.802163 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-96a00102-719e-4013-8275-ca5fbd88d113 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:11.802612 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-96a00102-719e-4013-8275-ca5fbd88d113 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:11.803382 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-96a00102-719e-4013-8275-ca5fbd88d113 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:11.803851 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-96a00102-719e-4013-8275-ca5fbd88d113 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:11.942885 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-96a00102-719e-4013-8275-ca5fbd88d113 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:43:11.950695 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-96a00102-719e-4013-8275-ca5fbd88d113 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 200 len: 1266 microversion: 2.1 time: 0.159853 Dec 20 09:43:11.951272 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 813/1660] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:43:11 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:43:12.967833 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9b70f43d-962e-49f8-ad62-617f6b00ff04 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:43:12.968431 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9b70f43d-962e-49f8-ad62-617f6b00ff04 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:43:12.974956 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9b70f43d-962e-49f8-ad62-617f6b00ff04 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:12.975406 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9b70f43d-962e-49f8-ad62-617f6b00ff04 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:12.976214 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9b70f43d-962e-49f8-ad62-617f6b00ff04 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:12.976655 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9b70f43d-962e-49f8-ad62-617f6b00ff04 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:13.108428 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-9b70f43d-962e-49f8-ad62-617f6b00ff04 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:43:13.116183 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9b70f43d-962e-49f8-ad62-617f6b00ff04 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 200 len: 1453 microversion: 2.1 time: 0.152039 Dec 20 09:43:13.116760 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 848/1661] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:43:12 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:43:13.132169 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-919eb867-380a-4783-9f64-2fa039ce986c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:43:13.132816 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-919eb867-380a-4783-9f64-2fa039ce986c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:43:13.139614 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-919eb867-380a-4783-9f64-2fa039ce986c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:13.140095 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-919eb867-380a-4783-9f64-2fa039ce986c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:13.140876 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-919eb867-380a-4783-9f64-2fa039ce986c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:13.141315 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-919eb867-380a-4783-9f64-2fa039ce986c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:13.268408 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-919eb867-380a-4783-9f64-2fa039ce986c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:43:13.275674 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-919eb867-380a-4783-9f64-2fa039ce986c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 200 len: 1453 microversion: 2.1 time: 0.147178 Dec 20 09:43:13.276247 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 814/1662] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:43:13 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:43:15.315809 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-e2c98f41-e6a8-4dad-bc35-e6e78f8a8efc req-d8f881cd-c1f4-473b-95c1-5f4474b4536f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a4b0d6-febf-488e-978d-8f4c2b4102d5", "tag": "63703bb7-df45-4534-8913-765870d1ec6a"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:43:15.317341 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:43:15.317341 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:43:15.324633 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-e2c98f41-e6a8-4dad-bc35-e6e78f8a8efc req-d8f881cd-c1f4-473b-95c1-5f4474b4536f service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:43:15.325072 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-e2c98f41-e6a8-4dad-bc35-e6e78f8a8efc req-d8f881cd-c1f4-473b-95c1-5f4474b4536f service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:43:15.335529 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-e2c98f41-e6a8-4dad-bc35-e6e78f8a8efc req-d8f881cd-c1f4-473b-95c1-5f4474b4536f service nova] Creating event network-changed:63703bb7-df45-4534-8913-765870d1ec6a for instance a2a4b0d6-febf-488e-978d-8f4c2b4102d5 on hv-cinder-81908 Dec 20 09:43:15.341796 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-e2c98f41-e6a8-4dad-bc35-e6e78f8a8efc req-d8f881cd-c1f4-473b-95c1-5f4474b4536f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029009 Dec 20 09:43:15.342327 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 849/1663] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:43:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:44:58.425144 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 20 09:44:58.425604 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: Mon Dec 20 09:44:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 20 09:45:00.214758 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 20 09:45:00.215365 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: Mon Dec 20 09:45:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 20 09:45:12.285930 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 20 09:45:12.286554 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: Mon Dec 20 09:45:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 20 09:45:25.710619 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 20 09:45:25.711225 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: Mon Dec 20 09:45:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 20 09:45:39.994888 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: ERROR oslo.messaging._drivers.impl_rabbit [-] [07107b3d-2f10-41e1-a383-6ec6a75d75da] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 20 09:45:39.999115 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0947337a-a6d3-45ec-ae4b-38d1d4766f62 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:45:39.999614 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0947337a-a6d3-45ec-ae4b-38d1d4766f62 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:45:40.005690 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0947337a-a6d3-45ec-ae4b-38d1d4766f62 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:40.006131 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0947337a-a6d3-45ec-ae4b-38d1d4766f62 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:40.006891 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0947337a-a6d3-45ec-ae4b-38d1d4766f62 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:40.007320 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0947337a-a6d3-45ec-ae4b-38d1d4766f62 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:40.031870 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0947337a-a6d3-45ec-ae4b-38d1d4766f62 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Going to try to terminate instance {{(pid=116675) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 09:45:40.273639 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0947337a-a6d3-45ec-ae4b-38d1d4766f62 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 204 len: 0 microversion: 2.1 time: 0.280311 Dec 20 09:45:40.274157 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 815/1664] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 20 09:45:39 2021] DELETE /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 09:45:40.281280 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bf5dfb94-1d1d-43da-9353-610c1c8088ea] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 20 09:45:40.285085 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-1e83196f-ec1f-4c8a-b40b-107fbec97546 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:45:40.285791 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-1e83196f-ec1f-4c8a-b40b-107fbec97546 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:45:40.292643 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1e83196f-ec1f-4c8a-b40b-107fbec97546 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:40.293099 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1e83196f-ec1f-4c8a-b40b-107fbec97546 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:40.293883 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1e83196f-ec1f-4c8a-b40b-107fbec97546 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:40.294322 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-1e83196f-ec1f-4c8a-b40b-107fbec97546 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:40.559030 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-1e83196f-ec1f-4c8a-b40b-107fbec97546 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:45:40.566280 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-1e83196f-ec1f-4c8a-b40b-107fbec97546 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 200 len: 1577 microversion: 2.1 time: 0.287248 Dec 20 09:45:40.566837 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 850/1665] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:45:40 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 1577 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:45:41.583480 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-587b79e8-a695-468e-b2c9-686836bef0f6 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:45:41.584141 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-587b79e8-a695-468e-b2c9-686836bef0f6 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:45:41.592273 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-587b79e8-a695-468e-b2c9-686836bef0f6 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:41.592716 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-587b79e8-a695-468e-b2c9-686836bef0f6 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:41.593482 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-587b79e8-a695-468e-b2c9-686836bef0f6 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:41.593913 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-587b79e8-a695-468e-b2c9-686836bef0f6 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:41.598898 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO oslo.messaging._drivers.impl_rabbit [-] [07107b3d-2f10-41e1-a383-6ec6a75d75da] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 40802. Dec 20 09:45:41.774238 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-587b79e8-a695-468e-b2c9-686836bef0f6 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:45:41.781685 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-587b79e8-a695-468e-b2c9-686836bef0f6 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 200 len: 1577 microversion: 2.1 time: 0.202264 Dec 20 09:45:41.782247 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 816/1666] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:45:41 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 1577 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:45:42.798110 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-6701af39-d69c-47fb-a680-ff9057db335e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:45:42.798727 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-6701af39-d69c-47fb-a680-ff9057db335e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:45:42.806058 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6701af39-d69c-47fb-a680-ff9057db335e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:42.806508 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6701af39-d69c-47fb-a680-ff9057db335e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:42.807837 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6701af39-d69c-47fb-a680-ff9057db335e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:42.808282 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-6701af39-d69c-47fb-a680-ff9057db335e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:42.827133 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO oslo.messaging._drivers.impl_rabbit [-] [bf5dfb94-1d1d-43da-9353-610c1c8088ea] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 40808. Dec 20 09:45:42.869816 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-6701af39-d69c-47fb-a680-ff9057db335e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:45:42.878770 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-6701af39-d69c-47fb-a680-ff9057db335e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 200 len: 1509 microversion: 2.1 time: 0.084347 Dec 20 09:45:42.883280 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 851/1667] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:45:42 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 1509 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:45:43.060357 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-bbd1dac6-8912-4ef3-af42-b0a5e1369804 req-18b0e1ed-2c35-4e30-aec1-636751ece6ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a4b0d6-febf-488e-978d-8f4c2b4102d5", "name": "network-vif-deleted", "tag": "63703bb7-df45-4534-8913-765870d1ec6a"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:45:43.062861 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:45:43.062861 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:45:43.070488 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-bbd1dac6-8912-4ef3-af42-b0a5e1369804 req-18b0e1ed-2c35-4e30-aec1-636751ece6ea service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:43.070926 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-bbd1dac6-8912-4ef3-af42-b0a5e1369804 req-18b0e1ed-2c35-4e30-aec1-636751ece6ea service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:43.082632 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-bbd1dac6-8912-4ef3-af42-b0a5e1369804 req-18b0e1ed-2c35-4e30-aec1-636751ece6ea service nova] Creating event network-vif-deleted:63703bb7-df45-4534-8913-765870d1ec6a for instance a2a4b0d6-febf-488e-978d-8f4c2b4102d5 on hv-cinder-81908 Dec 20 09:45:43.088543 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-bbd1dac6-8912-4ef3-af42-b0a5e1369804 req-18b0e1ed-2c35-4e30-aec1-636751ece6ea service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097142 Dec 20 09:45:43.089155 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 817/1668] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:45:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:45:43.896453 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-5ab66530-8e9e-4121-bfbf-1ef7d360459d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:45:43.899235 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-5ab66530-8e9e-4121-bfbf-1ef7d360459d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:45:43.904317 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5ab66530-8e9e-4121-bfbf-1ef7d360459d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:43.904770 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5ab66530-8e9e-4121-bfbf-1ef7d360459d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:43.905563 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5ab66530-8e9e-4121-bfbf-1ef7d360459d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:43.906000 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5ab66530-8e9e-4121-bfbf-1ef7d360459d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:43.937617 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5ab66530-8e9e-4121-bfbf-1ef7d360459d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:43.938164 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-5ab66530-8e9e-4121-bfbf-1ef7d360459d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:43.938616 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.objects.instance [None req-5ab66530-8e9e-4121-bfbf-1ef7d360459d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lazy-loading 'fault' on Instance uuid a2a4b0d6-febf-488e-978d-8f4c2b4102d5 {{(pid=116674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:45:43.980462 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-5ab66530-8e9e-4121-bfbf-1ef7d360459d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:45:43.988011 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-5ab66530-8e9e-4121-bfbf-1ef7d360459d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 200 len: 1230 microversion: 2.1 time: 0.095179 Dec 20 09:45:43.988700 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 852/1669] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:45:43 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:45:45.005880 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-94269683-6f60-46b4-bbec-029303ee240d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:45:45.006583 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-94269683-6f60-46b4-bbec-029303ee240d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:45:45.013761 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-94269683-6f60-46b4-bbec-029303ee240d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:45.014202 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-94269683-6f60-46b4-bbec-029303ee240d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:45.015034 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-94269683-6f60-46b4-bbec-029303ee240d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:45.015467 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-94269683-6f60-46b4-bbec-029303ee240d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:45.028068 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-94269683-6f60-46b4-bbec-029303ee240d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] HTTP exception thrown: Instance a2a4b0d6-febf-488e-978d-8f4c2b4102d5 could not be found. Dec 20 09:45:45.028642 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-94269683-6f60-46b4-bbec-029303ee240d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Returning 404 to user: Instance a2a4b0d6-febf-488e-978d-8f4c2b4102d5 could not be found. {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:45:45.029438 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-94269683-6f60-46b4-bbec-029303ee240d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 404 len: 111 microversion: 2.1 time: 0.027624 Dec 20 09:45:45.029964 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 818/1670] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:45:45 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:45:45.074703 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-0215604f-9d21-4663-9712-36ea3a744c55 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1666643860", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2061179994", "security_groups": [{"name": "tempest-secgroup-smoke-1114357505"}], "block_device_mapping_v2": [{"uuid": "e49774c1-96d1-4855-8a29-683da3709098", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "55b3223d-d4ab-4041-8d10-5ec0548f2a32"}]}} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:45:45.185202 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.network.neutron [None req-0215604f-9d21-4663-9712-36ea3a744c55 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] validate_networks() for [('55b3223d-d4ab-4041-8d10-5ec0548f2a32', None, None, None, None, None)] {{(pid=116674) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 09:45:45.590622 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-0215604f-9d21-4663-9712-36ea3a744c55 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Flavor limits 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 09:45:45.591039 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-0215604f-9d21-4663-9712-36ea3a744c55 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Image limits 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 09:45:45.591504 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-0215604f-9d21-4663-9712-36ea3a744c55 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Flavor pref 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 09:45:45.591937 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-0215604f-9d21-4663-9712-36ea3a744c55 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Image pref 0:0:0 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 09:45:45.592340 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.virt.hardware [None req-0215604f-9d21-4663-9712-36ea3a744c55 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 09:45:45.600722 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0215604f-9d21-4663-9712-36ea3a744c55 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:45.601161 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0215604f-9d21-4663-9712-36ea3a744c55 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:45.601981 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0215604f-9d21-4663-9712-36ea3a744c55 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:45.602442 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-0215604f-9d21-4663-9712-36ea3a744c55 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:45.618244 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-0215604f-9d21-4663-9712-36ea3a744c55 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Getting quotas for project 55caff02fd494487955d97e9c4a5f9f6. Resources: {'ram', 'cores', 'instances'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:45:45.622514 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.quota [None req-0215604f-9d21-4663-9712-36ea3a744c55 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Getting quotas for user 9f0bad80facd40ae8187b4c192c40ede and project 55caff02fd494487955d97e9c4a5f9f6. Resources: {'ram', 'cores', 'instances'} {{(pid=116674) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:45:45.684209 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0215604f-9d21-4663-9712-36ea3a744c55 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Going to run 1 instances... {{(pid=116674) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 09:45:45.686337 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-0215604f-9d21-4663-9712-36ea3a744c55 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e49774c1-96d1-4855-8a29-683da3709098',volume_size=None,volume_type=None)] {{(pid=116674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 09:45:46.176319 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-0215604f-9d21-4663-9712-36ea3a744c55 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.105953 Dec 20 09:45:46.177251 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 853/1671] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 20 09:45:45 2021] POST /compute/v2.1/servers => generated 406 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 09:45:46.187350 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-4a3a4735-0f17-4564-a429-2100323e7c85 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:45:46.187977 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-4a3a4735-0f17-4564-a429-2100323e7c85 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:45:46.245171 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-4a3a4735-0f17-4564-a429-2100323e7c85 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:45:46.251940 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-4a3a4735-0f17-4564-a429-2100323e7c85 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12" status: 200 len: 1095 microversion: 2.1 time: 0.068182 Dec 20 09:45:46.252509 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 819/1672] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:45:46 2021] GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:45:47.269786 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-699ffb36-40c7-44f3-b25b-1bee5d36a967 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:45:47.270425 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-699ffb36-40c7-44f3-b25b-1bee5d36a967 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:45:47.277112 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-699ffb36-40c7-44f3-b25b-1bee5d36a967 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:47.277561 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-699ffb36-40c7-44f3-b25b-1bee5d36a967 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:47.278341 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-699ffb36-40c7-44f3-b25b-1bee5d36a967 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:47.278775 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-699ffb36-40c7-44f3-b25b-1bee5d36a967 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:47.338982 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-699ffb36-40c7-44f3-b25b-1bee5d36a967 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:45:47.346352 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-699ffb36-40c7-44f3-b25b-1bee5d36a967 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12" status: 200 len: 1145 microversion: 2.1 time: 0.080939 Dec 20 09:45:47.346933 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 854/1673] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:45:47 2021] GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:45:48.363965 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-cffb9c90-a9a6-4ff3-9442-e76b6f0edce4 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:45:48.364911 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-cffb9c90-a9a6-4ff3-9442-e76b6f0edce4 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:45:48.371867 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cffb9c90-a9a6-4ff3-9442-e76b6f0edce4 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:48.372325 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cffb9c90-a9a6-4ff3-9442-e76b6f0edce4 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:48.373117 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cffb9c90-a9a6-4ff3-9442-e76b6f0edce4 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:48.373553 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-cffb9c90-a9a6-4ff3-9442-e76b6f0edce4 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:48.437046 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-cffb9c90-a9a6-4ff3-9442-e76b6f0edce4 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:45:48.441007 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-cffb9c90-a9a6-4ff3-9442-e76b6f0edce4 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12" status: 200 len: 1211 microversion: 2.1 time: 0.081070 Dec 20 09:45:48.441574 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 820/1674] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:45:48 2021] GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12 => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:45:49.458143 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-82609d1f-ca8a-4a3d-9b4f-b2223fb1b3f0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:45:49.459128 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-82609d1f-ca8a-4a3d-9b4f-b2223fb1b3f0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:45:49.466044 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-82609d1f-ca8a-4a3d-9b4f-b2223fb1b3f0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:49.466497 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-82609d1f-ca8a-4a3d-9b4f-b2223fb1b3f0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:49.467294 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-82609d1f-ca8a-4a3d-9b4f-b2223fb1b3f0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:49.467757 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-82609d1f-ca8a-4a3d-9b4f-b2223fb1b3f0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:49.611636 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-82609d1f-ca8a-4a3d-9b4f-b2223fb1b3f0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:45:49.619145 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-82609d1f-ca8a-4a3d-9b4f-b2223fb1b3f0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12" status: 200 len: 1267 microversion: 2.1 time: 0.164595 Dec 20 09:45:49.619780 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 855/1675] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:45:49 2021] GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:45:49.757661 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-13521d88-c26a-40c5-a619-dcc7f18c2a17 req-9e2007e6-d603-4a65-a08f-1dcf200f0d78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c70e5477-8f9a-4f0b-955f-b4db76527c12", "tag": "78fbb9c4-f41d-47b0-80d1-4bb80500815c"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:45:49.759601 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:45:49.759601 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:45:49.769520 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-13521d88-c26a-40c5-a619-dcc7f18c2a17 req-9e2007e6-d603-4a65-a08f-1dcf200f0d78 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:49.769957 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-13521d88-c26a-40c5-a619-dcc7f18c2a17 req-9e2007e6-d603-4a65-a08f-1dcf200f0d78 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:49.783410 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-13521d88-c26a-40c5-a619-dcc7f18c2a17 req-9e2007e6-d603-4a65-a08f-1dcf200f0d78 service nova] Creating event network-changed:78fbb9c4-f41d-47b0-80d1-4bb80500815c for instance c70e5477-8f9a-4f0b-955f-b4db76527c12 on hv-cinder-81908 Dec 20 09:45:49.791633 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-13521d88-c26a-40c5-a619-dcc7f18c2a17 req-9e2007e6-d603-4a65-a08f-1dcf200f0d78 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035061 Dec 20 09:45:49.791633 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 821/1676] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:45:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:45:50.636506 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-960b372c-db80-425d-80fe-1e9b0ed1186c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:45:50.637165 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-960b372c-db80-425d-80fe-1e9b0ed1186c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:45:50.643709 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-960b372c-db80-425d-80fe-1e9b0ed1186c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:50.644170 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-960b372c-db80-425d-80fe-1e9b0ed1186c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:50.644961 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-960b372c-db80-425d-80fe-1e9b0ed1186c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:50.645406 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-960b372c-db80-425d-80fe-1e9b0ed1186c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:50.776039 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-960b372c-db80-425d-80fe-1e9b0ed1186c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:45:50.783248 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-960b372c-db80-425d-80fe-1e9b0ed1186c tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12" status: 200 len: 1267 microversion: 2.1 time: 0.151279 Dec 20 09:45:50.783849 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 856/1677] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:45:50 2021] GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:45:51.800976 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-b5882da6-04ad-4ff1-9b09-96665e5f6e51 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:45:51.801598 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-b5882da6-04ad-4ff1-9b09-96665e5f6e51 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:45:51.808173 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b5882da6-04ad-4ff1-9b09-96665e5f6e51 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:51.808630 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b5882da6-04ad-4ff1-9b09-96665e5f6e51 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:51.809410 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b5882da6-04ad-4ff1-9b09-96665e5f6e51 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:51.809847 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-b5882da6-04ad-4ff1-9b09-96665e5f6e51 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:51.938926 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-b5882da6-04ad-4ff1-9b09-96665e5f6e51 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:45:51.946354 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-b5882da6-04ad-4ff1-9b09-96665e5f6e51 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12" status: 200 len: 1267 microversion: 2.1 time: 0.149528 Dec 20 09:45:51.950648 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 822/1678] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:45:51 2021] GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:45:52.963254 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-bf087a73-5ad8-4598-ab28-4834bd34e8d1 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:45:52.964492 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-bf087a73-5ad8-4598-ab28-4834bd34e8d1 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:45:52.970759 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bf087a73-5ad8-4598-ab28-4834bd34e8d1 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:52.971202 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bf087a73-5ad8-4598-ab28-4834bd34e8d1 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:52.972013 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bf087a73-5ad8-4598-ab28-4834bd34e8d1 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:52.972447 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-bf087a73-5ad8-4598-ab28-4834bd34e8d1 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:53.104018 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-bf087a73-5ad8-4598-ab28-4834bd34e8d1 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:45:53.111922 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-bf087a73-5ad8-4598-ab28-4834bd34e8d1 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12" status: 200 len: 1267 microversion: 2.1 time: 0.152360 Dec 20 09:45:53.112487 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 857/1679] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:45:52 2021] GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:45:54.128784 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-5419a83f-62c0-4d62-bf8a-c745d4c73532 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:45:54.129384 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-5419a83f-62c0-4d62-bf8a-c745d4c73532 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:45:54.136101 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5419a83f-62c0-4d62-bf8a-c745d4c73532 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:54.136548 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5419a83f-62c0-4d62-bf8a-c745d4c73532 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:54.137306 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5419a83f-62c0-4d62-bf8a-c745d4c73532 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:54.137733 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-5419a83f-62c0-4d62-bf8a-c745d4c73532 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:54.265516 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-5419a83f-62c0-4d62-bf8a-c745d4c73532 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:45:54.272652 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-5419a83f-62c0-4d62-bf8a-c745d4c73532 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12" status: 200 len: 1267 microversion: 2.1 time: 0.147569 Dec 20 09:45:54.273213 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 823/1680] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:45:54 2021] GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:45:55.290113 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-671dcd96-5649-490e-9ae3-9de6bab1c7c3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:45:55.290723 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-671dcd96-5649-490e-9ae3-9de6bab1c7c3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:45:55.297610 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-671dcd96-5649-490e-9ae3-9de6bab1c7c3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:55.298063 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-671dcd96-5649-490e-9ae3-9de6bab1c7c3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:55.298844 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-671dcd96-5649-490e-9ae3-9de6bab1c7c3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:55.299279 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-671dcd96-5649-490e-9ae3-9de6bab1c7c3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:55.445179 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-671dcd96-5649-490e-9ae3-9de6bab1c7c3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:45:55.453670 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-671dcd96-5649-490e-9ae3-9de6bab1c7c3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12" status: 200 len: 1267 microversion: 2.1 time: 0.167511 Dec 20 09:45:55.454282 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 858/1681] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:45:55 2021] GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:45:56.470125 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8b5312f7-21f6-45e8-805d-77453ff8cbc0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:45:56.470739 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8b5312f7-21f6-45e8-805d-77453ff8cbc0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:45:56.476987 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8b5312f7-21f6-45e8-805d-77453ff8cbc0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:56.477435 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8b5312f7-21f6-45e8-805d-77453ff8cbc0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:56.478209 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8b5312f7-21f6-45e8-805d-77453ff8cbc0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:56.478641 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8b5312f7-21f6-45e8-805d-77453ff8cbc0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:56.614272 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8b5312f7-21f6-45e8-805d-77453ff8cbc0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:45:56.626260 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8b5312f7-21f6-45e8-805d-77453ff8cbc0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12" status: 200 len: 1267 microversion: 2.1 time: 0.159575 Dec 20 09:45:56.627256 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 824/1682] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:45:56 2021] GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:45:57.648968 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-013c1fa9-90c3-4112-9f41-c1c3ceb49027 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:45:57.649608 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-013c1fa9-90c3-4112-9f41-c1c3ceb49027 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:45:57.656714 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-013c1fa9-90c3-4112-9f41-c1c3ceb49027 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:57.657167 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-013c1fa9-90c3-4112-9f41-c1c3ceb49027 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:57.657945 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-013c1fa9-90c3-4112-9f41-c1c3ceb49027 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:57.658381 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-013c1fa9-90c3-4112-9f41-c1c3ceb49027 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:57.788283 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-013c1fa9-90c3-4112-9f41-c1c3ceb49027 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:45:57.796245 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-013c1fa9-90c3-4112-9f41-c1c3ceb49027 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12" status: 200 len: 1267 microversion: 2.1 time: 0.150928 Dec 20 09:45:57.796814 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 859/1683] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:45:57 2021] GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:45:58.813348 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-8b2fa4eb-f5f2-404b-b68a-173473fec96e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:45:58.813955 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-8b2fa4eb-f5f2-404b-b68a-173473fec96e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:45:58.820207 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8b2fa4eb-f5f2-404b-b68a-173473fec96e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:58.820661 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8b2fa4eb-f5f2-404b-b68a-173473fec96e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:58.821444 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8b2fa4eb-f5f2-404b-b68a-173473fec96e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:58.821886 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-8b2fa4eb-f5f2-404b-b68a-173473fec96e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:58.953052 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-8b2fa4eb-f5f2-404b-b68a-173473fec96e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:45:58.960254 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-8b2fa4eb-f5f2-404b-b68a-173473fec96e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12" status: 200 len: 1267 microversion: 2.1 time: 0.150591 Dec 20 09:45:58.960816 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 825/1684] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:45:58 2021] GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:45:59.976954 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-72f0db46-981d-410a-968c-502d9e7e1c15 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:45:59.977542 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-72f0db46-981d-410a-968c-502d9e7e1c15 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:45:59.984079 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-72f0db46-981d-410a-968c-502d9e7e1c15 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:59.984525 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-72f0db46-981d-410a-968c-502d9e7e1c15 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:45:59.985290 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-72f0db46-981d-410a-968c-502d9e7e1c15 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:45:59.985718 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-72f0db46-981d-410a-968c-502d9e7e1c15 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:46:00.114875 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-72f0db46-981d-410a-968c-502d9e7e1c15 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:46:00.122043 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-72f0db46-981d-410a-968c-502d9e7e1c15 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12" status: 200 len: 1267 microversion: 2.1 time: 0.148717 Dec 20 09:46:00.122601 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 860/1685] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:45:59 2021] GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:46:01.033352 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-ace61939-0957-4786-a97b-13ddd3c4a2f2 req-d5471565-8b3f-4217-b5fd-2d67bb7f6e5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c70e5477-8f9a-4f0b-955f-b4db76527c12", "name": "network-vif-plugged", "status": "completed", "tag": "78fbb9c4-f41d-47b0-80d1-4bb80500815c"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:46:01.034844 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:46:01.034844 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:46:01.041556 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-ace61939-0957-4786-a97b-13ddd3c4a2f2 req-d5471565-8b3f-4217-b5fd-2d67bb7f6e5b service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:46:01.042905 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-ace61939-0957-4786-a97b-13ddd3c4a2f2 req-d5471565-8b3f-4217-b5fd-2d67bb7f6e5b service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:46:01.058581 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-ace61939-0957-4786-a97b-13ddd3c4a2f2 req-d5471565-8b3f-4217-b5fd-2d67bb7f6e5b service nova] Creating event network-vif-plugged:78fbb9c4-f41d-47b0-80d1-4bb80500815c for instance c70e5477-8f9a-4f0b-955f-b4db76527c12 on hv-cinder-81908 Dec 20 09:46:01.063842 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-ace61939-0957-4786-a97b-13ddd3c4a2f2 req-d5471565-8b3f-4217-b5fd-2d67bb7f6e5b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089377 Dec 20 09:46:01.064514 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 826/1686] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:46:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:46:01.138620 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7dc5df4b-3f22-437f-9311-01311f02110d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:46:01.139273 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7dc5df4b-3f22-437f-9311-01311f02110d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:46:01.146794 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7dc5df4b-3f22-437f-9311-01311f02110d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:46:01.147249 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7dc5df4b-3f22-437f-9311-01311f02110d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:46:01.148063 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7dc5df4b-3f22-437f-9311-01311f02110d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:46:01.148506 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7dc5df4b-3f22-437f-9311-01311f02110d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:46:01.284073 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7dc5df4b-3f22-437f-9311-01311f02110d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:46:01.291408 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7dc5df4b-3f22-437f-9311-01311f02110d tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12" status: 200 len: 1267 microversion: 2.1 time: 0.156998 Dec 20 09:46:01.292178 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 861/1687] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:46:01 2021] GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:46:02.309153 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0f837dcc-0644-4f23-a29b-0acc08224a22 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:46:02.309854 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0f837dcc-0644-4f23-a29b-0acc08224a22 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:46:02.315973 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0f837dcc-0644-4f23-a29b-0acc08224a22 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:46:02.316425 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0f837dcc-0644-4f23-a29b-0acc08224a22 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:46:02.317201 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0f837dcc-0644-4f23-a29b-0acc08224a22 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:46:02.317637 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0f837dcc-0644-4f23-a29b-0acc08224a22 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:46:02.447332 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-0f837dcc-0644-4f23-a29b-0acc08224a22 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:46:02.455146 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0f837dcc-0644-4f23-a29b-0acc08224a22 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12" status: 200 len: 1267 microversion: 2.1 time: 0.150522 Dec 20 09:46:02.455730 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 827/1688] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:46:02 2021] GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:46:03.472552 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7a8323dc-13a9-49c9-8155-b5342bc41aed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:46:03.473212 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7a8323dc-13a9-49c9-8155-b5342bc41aed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:46:03.479738 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7a8323dc-13a9-49c9-8155-b5342bc41aed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:46:03.480190 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7a8323dc-13a9-49c9-8155-b5342bc41aed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:46:03.480974 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7a8323dc-13a9-49c9-8155-b5342bc41aed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:46:03.481412 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7a8323dc-13a9-49c9-8155-b5342bc41aed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:46:03.607270 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7a8323dc-13a9-49c9-8155-b5342bc41aed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:46:03.614619 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7a8323dc-13a9-49c9-8155-b5342bc41aed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12" status: 200 len: 1455 microversion: 2.1 time: 0.145788 Dec 20 09:46:03.615224 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 862/1689] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:46:03 2021] GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12 => generated 1455 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:46:03.632289 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-d1cae9fe-dc63-4ac1-add3-f3813c1314ae tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:46:03.632899 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-d1cae9fe-dc63-4ac1-add3-f3813c1314ae tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:46:03.643641 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1cae9fe-dc63-4ac1-add3-f3813c1314ae tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:46:03.644130 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1cae9fe-dc63-4ac1-add3-f3813c1314ae tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:46:03.644914 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1cae9fe-dc63-4ac1-add3-f3813c1314ae tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:46:03.645344 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-d1cae9fe-dc63-4ac1-add3-f3813c1314ae tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:46:03.777518 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-d1cae9fe-dc63-4ac1-add3-f3813c1314ae tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:46:03.784767 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-d1cae9fe-dc63-4ac1-add3-f3813c1314ae tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12" status: 200 len: 1455 microversion: 2.1 time: 0.157006 Dec 20 09:46:03.785334 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 828/1690] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:46:03 2021] GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12 => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:46:05.921278 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-32a5c056-2334-468e-bb11-2ac55f534d71 req-8f3c25c4-1149-4684-b710-95b4b0907ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c70e5477-8f9a-4f0b-955f-b4db76527c12", "tag": "78fbb9c4-f41d-47b0-80d1-4bb80500815c"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:46:05.922841 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:46:05.922841 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:46:05.930102 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-32a5c056-2334-468e-bb11-2ac55f534d71 req-8f3c25c4-1149-4684-b710-95b4b0907ca4 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:46:05.930553 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-32a5c056-2334-468e-bb11-2ac55f534d71 req-8f3c25c4-1149-4684-b710-95b4b0907ca4 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:46:05.941330 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-32a5c056-2334-468e-bb11-2ac55f534d71 req-8f3c25c4-1149-4684-b710-95b4b0907ca4 service nova] Creating event network-changed:78fbb9c4-f41d-47b0-80d1-4bb80500815c for instance c70e5477-8f9a-4f0b-955f-b4db76527c12 on hv-cinder-81908 Dec 20 09:46:05.946307 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-32a5c056-2334-468e-bb11-2ac55f534d71 req-8f3c25c4-1149-4684-b710-95b4b0907ca4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029299 Dec 20 09:46:05.946882 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 863/1691] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:46:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 20 09:48:16.642854 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e3b30992-6f7f-4d47-bd78-a6d56b1aa879 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1424198433", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2061179994", "security_groups": [{"name": "tempest-secgroup-smoke-1114357505"}], "block_device_mapping_v2": [{"uuid": "3564a623-5f60-4054-b54c-1b729807db8c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "55b3223d-d4ab-4041-8d10-5ec0548f2a32"}]}} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:48:16.747408 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.network.neutron [None req-e3b30992-6f7f-4d47-bd78-a6d56b1aa879 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] validate_networks() for [('55b3223d-d4ab-4041-8d10-5ec0548f2a32', None, None, None, None, None)] {{(pid=116675) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 20 09:48:17.150081 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-e3b30992-6f7f-4d47-bd78-a6d56b1aa879 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Flavor limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 20 09:48:17.150503 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-e3b30992-6f7f-4d47-bd78-a6d56b1aa879 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Image limits 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 20 09:48:17.150977 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-e3b30992-6f7f-4d47-bd78-a6d56b1aa879 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Flavor pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 20 09:48:17.151385 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-e3b30992-6f7f-4d47-bd78-a6d56b1aa879 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Image pref 0:0:0 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 20 09:48:17.151826 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.virt.hardware [None req-e3b30992-6f7f-4d47-bd78-a6d56b1aa879 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 20 09:48:17.160782 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e3b30992-6f7f-4d47-bd78-a6d56b1aa879 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:17.161229 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e3b30992-6f7f-4d47-bd78-a6d56b1aa879 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:17.162040 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e3b30992-6f7f-4d47-bd78-a6d56b1aa879 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:17.162476 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-e3b30992-6f7f-4d47-bd78-a6d56b1aa879 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:17.180196 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-e3b30992-6f7f-4d47-bd78-a6d56b1aa879 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Getting quotas for project 55caff02fd494487955d97e9c4a5f9f6. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 20 09:48:17.184185 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.quota [None req-e3b30992-6f7f-4d47-bd78-a6d56b1aa879 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Getting quotas for user 9f0bad80facd40ae8187b4c192c40ede and project 55caff02fd494487955d97e9c4a5f9f6. Resources: {'ram', 'cores', 'instances'} {{(pid=116675) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 20 09:48:17.238744 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e3b30992-6f7f-4d47-bd78-a6d56b1aa879 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Going to run 1 instances... {{(pid=116675) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 20 09:48:17.240885 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e3b30992-6f7f-4d47-bd78-a6d56b1aa879 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3564a623-5f60-4054-b54c-1b729807db8c',volume_size=None,volume_type=None)] {{(pid=116675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 20 09:48:17.596437 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e3b30992-6f7f-4d47-bd78-a6d56b1aa879 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [4f13399f-34be-49c2-9ba2-00afa9d42b20] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 20 09:48:18.604324 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO oslo.messaging._drivers.impl_rabbit [None req-e3b30992-6f7f-4d47-bd78-a6d56b1aa879 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [4f13399f-34be-49c2-9ba2-00afa9d42b20] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 40980. Dec 20 09:48:18.608834 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e3b30992-6f7f-4d47-bd78-a6d56b1aa879 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.971120 Dec 20 09:48:18.609906 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 829/1692] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 20 09:48:16 2021] POST /compute/v2.1/servers => generated 406 bytes in 1973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 20 09:48:18.618033 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bf5dfb94-1d1d-43da-9353-610c1c8088ea] AMQP server on 10.222.0.62:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 20 09:48:18.621915 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b7c817b2-6515-46bc-90e7-8f9c5bdc1c19 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:48:18.622622 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b7c817b2-6515-46bc-90e7-8f9c5bdc1c19 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:48:18.673499 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b7c817b2-6515-46bc-90e7-8f9c5bdc1c19 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:48:18.679958 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b7c817b2-6515-46bc-90e7-8f9c5bdc1c19 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1095 microversion: 2.1 time: 0.063843 Dec 20 09:48:18.680548 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 864/1693] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:48:18 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:48:19.696792 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-e0f8e0e3-1dbf-4ccc-9704-ca4d3b77a773 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:48:19.697399 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-e0f8e0e3-1dbf-4ccc-9704-ca4d3b77a773 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:48:19.746507 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-e0f8e0e3-1dbf-4ccc-9704-ca4d3b77a773 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:48:19.753611 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-e0f8e0e3-1dbf-4ccc-9704-ca4d3b77a773 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1095 microversion: 2.1 time: 0.060861 Dec 20 09:48:19.754177 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 830/1694] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:48:19 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1095 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:48:20.223129 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 20 09:48:20.223731 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: Mon Dec 20 09:48:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 20 09:48:20.770052 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-814b6ca0-66b0-49dd-953f-6e958b49f877 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:48:20.770668 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-814b6ca0-66b0-49dd-953f-6e958b49f877 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:48:20.784235 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO oslo.messaging._drivers.impl_rabbit [-] [bf5dfb94-1d1d-43da-9353-610c1c8088ea] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 41008. Dec 20 09:48:20.830848 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-814b6ca0-66b0-49dd-953f-6e958b49f877 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:48:20.837517 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-814b6ca0-66b0-49dd-953f-6e958b49f877 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1095 microversion: 2.1 time: 0.071063 Dec 20 09:48:20.838086 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 865/1695] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:48:20 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:48:21.854377 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-3e62dd1c-78cc-4849-b7b4-2fc9694e7542 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:48:21.854928 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-3e62dd1c-78cc-4849-b7b4-2fc9694e7542 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:48:21.905690 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-3e62dd1c-78cc-4849-b7b4-2fc9694e7542 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:48:21.912063 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-3e62dd1c-78cc-4849-b7b4-2fc9694e7542 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1095 microversion: 2.1 time: 0.061729 Dec 20 09:48:21.912622 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 831/1696] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:48:21 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1095 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 20 09:48:22.928051 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-393191aa-f29a-41a6-af3e-951d63d213fd tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:48:22.928689 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-393191aa-f29a-41a6-af3e-951d63d213fd tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:48:22.935100 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-393191aa-f29a-41a6-af3e-951d63d213fd tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:22.935554 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-393191aa-f29a-41a6-af3e-951d63d213fd tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:22.936367 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-393191aa-f29a-41a6-af3e-951d63d213fd tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:22.936807 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-393191aa-f29a-41a6-af3e-951d63d213fd tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:22.995570 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-393191aa-f29a-41a6-af3e-951d63d213fd tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:48:23.003007 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-393191aa-f29a-41a6-af3e-951d63d213fd tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1145 microversion: 2.1 time: 0.078588 Dec 20 09:48:23.003602 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 866/1697] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:48:22 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:48:24.019102 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-39599eb2-80ee-40c1-bdc3-c4a9d6b2b3ed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:48:24.019687 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-39599eb2-80ee-40c1-bdc3-c4a9d6b2b3ed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:48:24.025980 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-39599eb2-80ee-40c1-bdc3-c4a9d6b2b3ed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:24.026432 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-39599eb2-80ee-40c1-bdc3-c4a9d6b2b3ed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:24.027210 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-39599eb2-80ee-40c1-bdc3-c4a9d6b2b3ed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:24.027650 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-39599eb2-80ee-40c1-bdc3-c4a9d6b2b3ed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:24.085604 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-39599eb2-80ee-40c1-bdc3-c4a9d6b2b3ed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:48:24.093353 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-39599eb2-80ee-40c1-bdc3-c4a9d6b2b3ed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1193 microversion: 2.1 time: 0.077879 Dec 20 09:48:24.093912 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 832/1698] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:48:24 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1193 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:48:25.111325 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-cbabef9b-0287-4691-baeb-e086b8975917 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:48:25.111325 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-cbabef9b-0287-4691-baeb-e086b8975917 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:48:25.118724 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cbabef9b-0287-4691-baeb-e086b8975917 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:25.119172 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cbabef9b-0287-4691-baeb-e086b8975917 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:25.121235 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cbabef9b-0287-4691-baeb-e086b8975917 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:25.121235 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-cbabef9b-0287-4691-baeb-e086b8975917 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:25.273879 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-cbabef9b-0287-4691-baeb-e086b8975917 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:48:25.281999 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-cbabef9b-0287-4691-baeb-e086b8975917 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1279 microversion: 2.1 time: 0.175778 Dec 20 09:48:25.282574 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 867/1699] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:48:25 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1279 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:48:25.982549 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-010e7cf0-941b-46f3-9085-093b2833f1a7 req-2d414850-5cac-4d74-b598-01431a79e736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80a806f3-1568-4a25-8056-52c41a395be8", "tag": "95e422ce-c6d7-4168-92fb-8ecba04f8bde"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:48:25.984028 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:48:25.984028 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:48:25.996965 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-010e7cf0-941b-46f3-9085-093b2833f1a7 req-2d414850-5cac-4d74-b598-01431a79e736 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:25.997918 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-010e7cf0-941b-46f3-9085-093b2833f1a7 req-2d414850-5cac-4d74-b598-01431a79e736 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:26.012222 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-010e7cf0-941b-46f3-9085-093b2833f1a7 req-2d414850-5cac-4d74-b598-01431a79e736 service nova] Creating event network-changed:95e422ce-c6d7-4168-92fb-8ecba04f8bde for instance 80a806f3-1568-4a25-8056-52c41a395be8 on hv-cinder-81908 Dec 20 09:48:26.017990 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-010e7cf0-941b-46f3-9085-093b2833f1a7 req-2d414850-5cac-4d74-b598-01431a79e736 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039528 Dec 20 09:48:26.018586 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 833/1700] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:48:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:48:26.304934 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-fcac9856-66bc-4941-83c7-7a34b011c9d0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:48:26.306313 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-fcac9856-66bc-4941-83c7-7a34b011c9d0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:48:26.314863 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fcac9856-66bc-4941-83c7-7a34b011c9d0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:26.315312 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fcac9856-66bc-4941-83c7-7a34b011c9d0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:26.316132 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fcac9856-66bc-4941-83c7-7a34b011c9d0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:26.316565 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-fcac9856-66bc-4941-83c7-7a34b011c9d0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:26.453451 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-fcac9856-66bc-4941-83c7-7a34b011c9d0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:48:26.461409 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-fcac9856-66bc-4941-83c7-7a34b011c9d0 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1267 microversion: 2.1 time: 0.160383 Dec 20 09:48:26.461986 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 868/1701] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:48:26 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:48:27.477748 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a4ccaf03-93ab-46b7-9cc4-9d5a86814539 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:48:27.478716 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a4ccaf03-93ab-46b7-9cc4-9d5a86814539 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:48:27.485315 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a4ccaf03-93ab-46b7-9cc4-9d5a86814539 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:27.485762 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a4ccaf03-93ab-46b7-9cc4-9d5a86814539 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:27.486532 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a4ccaf03-93ab-46b7-9cc4-9d5a86814539 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:27.486962 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a4ccaf03-93ab-46b7-9cc4-9d5a86814539 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:27.614990 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a4ccaf03-93ab-46b7-9cc4-9d5a86814539 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:48:27.622188 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a4ccaf03-93ab-46b7-9cc4-9d5a86814539 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1267 microversion: 2.1 time: 0.148481 Dec 20 09:48:27.623254 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 834/1702] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:48:27 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:48:28.639796 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-8289b81c-8161-4b52-acb2-66c3387e8116 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:48:28.640406 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-8289b81c-8161-4b52-acb2-66c3387e8116 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:48:28.646659 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8289b81c-8161-4b52-acb2-66c3387e8116 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:28.647474 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8289b81c-8161-4b52-acb2-66c3387e8116 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:28.647900 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8289b81c-8161-4b52-acb2-66c3387e8116 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:28.648339 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-8289b81c-8161-4b52-acb2-66c3387e8116 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:28.779723 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-8289b81c-8161-4b52-acb2-66c3387e8116 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:48:28.786932 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-8289b81c-8161-4b52-acb2-66c3387e8116 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1267 microversion: 2.1 time: 0.151379 Dec 20 09:48:28.787500 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 869/1703] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:48:28 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:48:29.803380 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-f5289aa3-76e0-4ba9-b16a-1f526b2d3abe tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:48:29.803957 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-f5289aa3-76e0-4ba9-b16a-1f526b2d3abe tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:48:29.810183 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f5289aa3-76e0-4ba9-b16a-1f526b2d3abe tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:29.810632 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f5289aa3-76e0-4ba9-b16a-1f526b2d3abe tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:29.811402 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f5289aa3-76e0-4ba9-b16a-1f526b2d3abe tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:29.811869 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-f5289aa3-76e0-4ba9-b16a-1f526b2d3abe tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:29.947004 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-f5289aa3-76e0-4ba9-b16a-1f526b2d3abe tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:48:29.954773 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-f5289aa3-76e0-4ba9-b16a-1f526b2d3abe tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1267 microversion: 2.1 time: 0.155210 Dec 20 09:48:29.955335 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 835/1704] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:48:29 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:48:30.971174 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-154d0119-6a3c-467c-8d87-5149bb6aa9fb tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:48:30.971836 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-154d0119-6a3c-467c-8d87-5149bb6aa9fb tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:48:30.978331 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-154d0119-6a3c-467c-8d87-5149bb6aa9fb tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:30.981460 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-154d0119-6a3c-467c-8d87-5149bb6aa9fb tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:30.981460 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-154d0119-6a3c-467c-8d87-5149bb6aa9fb tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:30.981460 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-154d0119-6a3c-467c-8d87-5149bb6aa9fb tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:31.112211 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-154d0119-6a3c-467c-8d87-5149bb6aa9fb tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:48:31.119373 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-154d0119-6a3c-467c-8d87-5149bb6aa9fb tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1267 microversion: 2.1 time: 0.151943 Dec 20 09:48:31.119973 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 870/1705] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:48:30 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:48:32.135778 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ca0b5f58-c80e-467a-a1b4-fec36f79afac tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:48:32.136394 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ca0b5f58-c80e-467a-a1b4-fec36f79afac tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:48:32.143230 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ca0b5f58-c80e-467a-a1b4-fec36f79afac tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:32.143703 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ca0b5f58-c80e-467a-a1b4-fec36f79afac tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:32.144488 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ca0b5f58-c80e-467a-a1b4-fec36f79afac tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:32.144927 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ca0b5f58-c80e-467a-a1b4-fec36f79afac tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:32.272002 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ca0b5f58-c80e-467a-a1b4-fec36f79afac tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:48:32.279100 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ca0b5f58-c80e-467a-a1b4-fec36f79afac tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1267 microversion: 2.1 time: 0.147026 Dec 20 09:48:32.279688 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 836/1706] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:48:32 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:48:32.295146 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 20 09:48:32.295684 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: Mon Dec 20 09:48:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 20 09:48:33.294914 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-7ca05f07-9361-4e34-b5df-ab1ecb8fa3fd tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:48:33.295557 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-7ca05f07-9361-4e34-b5df-ab1ecb8fa3fd tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:48:33.301925 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7ca05f07-9361-4e34-b5df-ab1ecb8fa3fd tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:33.302370 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7ca05f07-9361-4e34-b5df-ab1ecb8fa3fd tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:33.303148 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7ca05f07-9361-4e34-b5df-ab1ecb8fa3fd tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:33.303617 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-7ca05f07-9361-4e34-b5df-ab1ecb8fa3fd tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:33.441485 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-7ca05f07-9361-4e34-b5df-ab1ecb8fa3fd tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:48:33.449562 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-7ca05f07-9361-4e34-b5df-ab1ecb8fa3fd tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1267 microversion: 2.1 time: 0.158342 Dec 20 09:48:33.450150 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 871/1707] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:48:33 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:48:34.466576 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-baf510a5-45ee-4923-9427-0b12d822b78e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:48:34.467181 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-baf510a5-45ee-4923-9427-0b12d822b78e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:48:34.473483 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-baf510a5-45ee-4923-9427-0b12d822b78e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:34.473933 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-baf510a5-45ee-4923-9427-0b12d822b78e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:34.474699 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-baf510a5-45ee-4923-9427-0b12d822b78e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:34.475132 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-baf510a5-45ee-4923-9427-0b12d822b78e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:34.604104 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-baf510a5-45ee-4923-9427-0b12d822b78e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:48:34.611755 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-baf510a5-45ee-4923-9427-0b12d822b78e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1267 microversion: 2.1 time: 0.148850 Dec 20 09:48:34.612335 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 837/1708] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:48:34 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:48:35.627198 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-b2c54538-a8d4-4c15-a43b-c38da60e6ede tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:48:35.627855 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-b2c54538-a8d4-4c15-a43b-c38da60e6ede tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:48:35.633870 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b2c54538-a8d4-4c15-a43b-c38da60e6ede tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:35.634319 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b2c54538-a8d4-4c15-a43b-c38da60e6ede tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:35.635143 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b2c54538-a8d4-4c15-a43b-c38da60e6ede tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:35.635535 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-b2c54538-a8d4-4c15-a43b-c38da60e6ede tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:35.764382 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-b2c54538-a8d4-4c15-a43b-c38da60e6ede tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:48:35.771685 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-b2c54538-a8d4-4c15-a43b-c38da60e6ede tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1267 microversion: 2.1 time: 0.147998 Dec 20 09:48:35.772242 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 872/1709] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:48:35 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:48:36.788107 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-2fd9f347-9b7c-4c58-a2f1-3fe591fdb487 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:48:36.788752 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-2fd9f347-9b7c-4c58-a2f1-3fe591fdb487 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:48:36.798259 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2fd9f347-9b7c-4c58-a2f1-3fe591fdb487 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:36.798811 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2fd9f347-9b7c-4c58-a2f1-3fe591fdb487 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:36.799610 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2fd9f347-9b7c-4c58-a2f1-3fe591fdb487 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:36.800071 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-2fd9f347-9b7c-4c58-a2f1-3fe591fdb487 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:36.932287 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-2fd9f347-9b7c-4c58-a2f1-3fe591fdb487 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:48:36.940080 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-2fd9f347-9b7c-4c58-a2f1-3fe591fdb487 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1267 microversion: 2.1 time: 0.155617 Dec 20 09:48:36.940646 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 838/1710] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:48:36 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:48:37.214380 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 20 09:48:37.214912 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: Mon Dec 20 09:48:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 20 09:48:37.558471 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-d61208fe-86b0-43b2-b05e-96228c9d4a10 req-a650dadd-7d32-448b-b5ad-6046e66c1653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80a806f3-1568-4a25-8056-52c41a395be8", "name": "network-vif-plugged", "status": "completed", "tag": "95e422ce-c6d7-4168-92fb-8ecba04f8bde"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:48:37.558471 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:48:37.558471 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:48:37.564908 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-d61208fe-86b0-43b2-b05e-96228c9d4a10 req-a650dadd-7d32-448b-b5ad-6046e66c1653 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:37.565356 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-d61208fe-86b0-43b2-b05e-96228c9d4a10 req-a650dadd-7d32-448b-b5ad-6046e66c1653 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:37.575869 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-d61208fe-86b0-43b2-b05e-96228c9d4a10 req-a650dadd-7d32-448b-b5ad-6046e66c1653 service nova] Creating event network-vif-plugged:95e422ce-c6d7-4168-92fb-8ecba04f8bde for instance 80a806f3-1568-4a25-8056-52c41a395be8 on hv-cinder-81908 Dec 20 09:48:37.581557 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-d61208fe-86b0-43b2-b05e-96228c9d4a10 req-a650dadd-7d32-448b-b5ad-6046e66c1653 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029870 Dec 20 09:48:37.584116 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 873/1711] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:48:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:48:37.956984 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-a28674c7-9c0c-4b12-a664-07f5a6ca7ac3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:48:37.957690 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-a28674c7-9c0c-4b12-a664-07f5a6ca7ac3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:48:37.963943 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a28674c7-9c0c-4b12-a664-07f5a6ca7ac3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:37.964392 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a28674c7-9c0c-4b12-a664-07f5a6ca7ac3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:37.965178 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a28674c7-9c0c-4b12-a664-07f5a6ca7ac3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:37.965618 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-a28674c7-9c0c-4b12-a664-07f5a6ca7ac3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:38.095153 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-a28674c7-9c0c-4b12-a664-07f5a6ca7ac3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:48:38.102319 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-a28674c7-9c0c-4b12-a664-07f5a6ca7ac3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1267 microversion: 2.1 time: 0.149054 Dec 20 09:48:38.103128 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 839/1712] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:48:37 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:48:39.120531 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-827cf0b8-a070-4d1f-848f-e743b6ef7f61 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:48:39.121180 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-827cf0b8-a070-4d1f-848f-e743b6ef7f61 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:48:39.127224 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-827cf0b8-a070-4d1f-848f-e743b6ef7f61 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:39.127689 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-827cf0b8-a070-4d1f-848f-e743b6ef7f61 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:39.128464 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-827cf0b8-a070-4d1f-848f-e743b6ef7f61 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:39.128899 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-827cf0b8-a070-4d1f-848f-e743b6ef7f61 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:39.268779 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-827cf0b8-a070-4d1f-848f-e743b6ef7f61 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:48:39.276065 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-827cf0b8-a070-4d1f-848f-e743b6ef7f61 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1267 microversion: 2.1 time: 0.160071 Dec 20 09:48:39.276633 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 874/1713] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:48:39 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:48:40.293216 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ad1919c3-aa0e-47be-b93f-834a9428526a tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:48:40.293848 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ad1919c3-aa0e-47be-b93f-834a9428526a tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:48:40.300124 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ad1919c3-aa0e-47be-b93f-834a9428526a tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:40.300569 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ad1919c3-aa0e-47be-b93f-834a9428526a tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:40.301339 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ad1919c3-aa0e-47be-b93f-834a9428526a tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:40.301773 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ad1919c3-aa0e-47be-b93f-834a9428526a tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:40.437359 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ad1919c3-aa0e-47be-b93f-834a9428526a tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:48:40.444787 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ad1919c3-aa0e-47be-b93f-834a9428526a tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1454 microversion: 2.1 time: 0.155215 Dec 20 09:48:40.445358 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 840/1714] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:48:40 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:48:40.461056 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-55d9b33a-29b5-4195-a0ec-b91d8a0c22d3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:48:40.461663 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-55d9b33a-29b5-4195-a0ec-b91d8a0c22d3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:48:40.468503 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-55d9b33a-29b5-4195-a0ec-b91d8a0c22d3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:40.468931 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-55d9b33a-29b5-4195-a0ec-b91d8a0c22d3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:40.469699 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-55d9b33a-29b5-4195-a0ec-b91d8a0c22d3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:40.470131 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-55d9b33a-29b5-4195-a0ec-b91d8a0c22d3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:40.597247 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-55d9b33a-29b5-4195-a0ec-b91d8a0c22d3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:48:40.604798 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-55d9b33a-29b5-4195-a0ec-b91d8a0c22d3 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1454 microversion: 2.1 time: 0.147327 Dec 20 09:48:40.605362 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 875/1715] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:48:40 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1454 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:48:42.845140 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-f62517b4-ea1c-46a4-ba76-e3ed28987b5f req-f8c7db8c-2273-47a5-815e-25755eaae4ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80a806f3-1568-4a25-8056-52c41a395be8", "tag": "95e422ce-c6d7-4168-92fb-8ecba04f8bde"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:48:42.846682 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:48:42.846682 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:48:42.853511 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-f62517b4-ea1c-46a4-ba76-e3ed28987b5f req-f8c7db8c-2273-47a5-815e-25755eaae4ae service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:48:42.853941 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-f62517b4-ea1c-46a4-ba76-e3ed28987b5f req-f8c7db8c-2273-47a5-815e-25755eaae4ae service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:48:42.864516 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-f62517b4-ea1c-46a4-ba76-e3ed28987b5f req-f8c7db8c-2273-47a5-815e-25755eaae4ae service nova] Creating event network-changed:95e422ce-c6d7-4168-92fb-8ecba04f8bde for instance 80a806f3-1568-4a25-8056-52c41a395be8 on hv-cinder-81908 Dec 20 09:48:42.869439 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-f62517b4-ea1c-46a4-ba76-e3ed28987b5f req-f8c7db8c-2273-47a5-815e-25755eaae4ae service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084203 Dec 20 09:48:42.870003 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 841/1716] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:48:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:48:45.719144 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 20 09:48:45.719808 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: Mon Dec 20 09:48:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 20 09:50:32.817767 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-d261ffbf-7106-417c-b8b7-179e86ed2a09 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:50:32.818291 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d261ffbf-7106-417c-b8b7-179e86ed2a09 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:50:32.823693 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [req-60211c83-5708-4b38-8ec5-2609e6bc8a9d req-584615f2-c79c-4ffc-87e0-32d36fc24642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80a806f3-1568-4a25-8056-52c41a395be8", "tag": "95e422ce-c6d7-4168-92fb-8ecba04f8bde"}]} {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:50:32.824708 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d261ffbf-7106-417c-b8b7-179e86ed2a09 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:32.824958 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:50:32.824958 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: warnings.warn(msg) Dec 20 09:50:32.825222 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d261ffbf-7106-417c-b8b7-179e86ed2a09 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:32.826136 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d261ffbf-7106-417c-b8b7-179e86ed2a09 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:32.827119 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-d261ffbf-7106-417c-b8b7-179e86ed2a09 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:32.832893 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-60211c83-5708-4b38-8ec5-2609e6bc8a9d req-584615f2-c79c-4ffc-87e0-32d36fc24642 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:32.833333 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [req-60211c83-5708-4b38-8ec5-2609e6bc8a9d req-584615f2-c79c-4ffc-87e0-32d36fc24642 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:32.844468 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.compute.server_external_events [req-60211c83-5708-4b38-8ec5-2609e6bc8a9d req-584615f2-c79c-4ffc-87e0-32d36fc24642 service nova] Creating event network-changed:95e422ce-c6d7-4168-92fb-8ecba04f8bde for instance 80a806f3-1568-4a25-8056-52c41a395be8 on hv-cinder-81908 Dec 20 09:50:32.849934 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [req-60211c83-5708-4b38-8ec5-2609e6bc8a9d req-584615f2-c79c-4ffc-87e0-32d36fc24642 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033704 Dec 20 09:50:32.852034 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 842/1717] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:50:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:50:32.852803 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-d261ffbf-7106-417c-b8b7-179e86ed2a09 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Going to try to terminate instance {{(pid=116674) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 09:50:33.150520 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-d261ffbf-7106-417c-b8b7-179e86ed2a09 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "DELETE /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 204 len: 0 microversion: 2.1 time: 0.337829 Dec 20 09:50:33.151955 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 876/1718] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 20 09:50:32 2021] DELETE /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 09:50:33.160012 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0e093288-200c-4b49-b5ac-c3dc7f4600ed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:50:33.160712 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0e093288-200c-4b49-b5ac-c3dc7f4600ed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:50:33.166993 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0e093288-200c-4b49-b5ac-c3dc7f4600ed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:33.167448 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0e093288-200c-4b49-b5ac-c3dc7f4600ed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:33.168666 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0e093288-200c-4b49-b5ac-c3dc7f4600ed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:33.169106 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0e093288-200c-4b49-b5ac-c3dc7f4600ed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:33.316009 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-0e093288-200c-4b49-b5ac-c3dc7f4600ed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:50:33.323924 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0e093288-200c-4b49-b5ac-c3dc7f4600ed tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1579 microversion: 2.1 time: 0.167990 Dec 20 09:50:33.325847 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 843/1719] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:50:33 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1579 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:50:34.343148 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-3fd648e2-d838-4ea8-8ba7-8825c178829b tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:50:34.343902 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-3fd648e2-d838-4ea8-8ba7-8825c178829b tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:50:34.350841 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3fd648e2-d838-4ea8-8ba7-8825c178829b tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:34.351548 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3fd648e2-d838-4ea8-8ba7-8825c178829b tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:34.352357 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3fd648e2-d838-4ea8-8ba7-8825c178829b tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:34.352794 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-3fd648e2-d838-4ea8-8ba7-8825c178829b tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:34.483044 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-3fd648e2-d838-4ea8-8ba7-8825c178829b tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:50:34.490422 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-3fd648e2-d838-4ea8-8ba7-8825c178829b tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1460 microversion: 2.1 time: 0.151374 Dec 20 09:50:34.490989 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 877/1720] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:50:34 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1460 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:50:35.507355 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-ebacd6eb-b9d9-41e0-85d7-1f4046f367a5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:50:35.507999 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-ebacd6eb-b9d9-41e0-85d7-1f4046f367a5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:50:35.514237 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ebacd6eb-b9d9-41e0-85d7-1f4046f367a5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:35.514688 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ebacd6eb-b9d9-41e0-85d7-1f4046f367a5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:35.515466 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ebacd6eb-b9d9-41e0-85d7-1f4046f367a5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:35.515934 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-ebacd6eb-b9d9-41e0-85d7-1f4046f367a5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:35.644757 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-ebacd6eb-b9d9-41e0-85d7-1f4046f367a5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:50:35.655166 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-ebacd6eb-b9d9-41e0-85d7-1f4046f367a5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1460 microversion: 2.1 time: 0.151398 Dec 20 09:50:35.656332 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 844/1721] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:50:35 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1460 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:50:35.706152 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-fe36e0f7-b3a7-48e1-b74a-99ad71cbfda8 req-440f9928-66cb-4f5c-9c00-b8269be09bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80a806f3-1568-4a25-8056-52c41a395be8", "name": "network-vif-deleted", "tag": "95e422ce-c6d7-4168-92fb-8ecba04f8bde"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:50:35.707652 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:50:35.707652 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:50:35.714841 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-fe36e0f7-b3a7-48e1-b74a-99ad71cbfda8 req-440f9928-66cb-4f5c-9c00-b8269be09bd7 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:35.715284 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-fe36e0f7-b3a7-48e1-b74a-99ad71cbfda8 req-440f9928-66cb-4f5c-9c00-b8269be09bd7 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:35.727167 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-fe36e0f7-b3a7-48e1-b74a-99ad71cbfda8 req-440f9928-66cb-4f5c-9c00-b8269be09bd7 service nova] Creating event network-vif-deleted:95e422ce-c6d7-4168-92fb-8ecba04f8bde for instance 80a806f3-1568-4a25-8056-52c41a395be8 on hv-cinder-81908 Dec 20 09:50:35.732709 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-fe36e0f7-b3a7-48e1-b74a-99ad71cbfda8 req-440f9928-66cb-4f5c-9c00-b8269be09bd7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029892 Dec 20 09:50:35.733319 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 878/1722] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:50:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:50:36.673721 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-38d6e383-8204-4bc5-9d57-50a863e44c12 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:50:36.674327 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-38d6e383-8204-4bc5-9d57-50a863e44c12 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:50:36.680660 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-38d6e383-8204-4bc5-9d57-50a863e44c12 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:36.681114 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-38d6e383-8204-4bc5-9d57-50a863e44c12 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:36.681894 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-38d6e383-8204-4bc5-9d57-50a863e44c12 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:36.682332 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-38d6e383-8204-4bc5-9d57-50a863e44c12 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:36.712459 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-38d6e383-8204-4bc5-9d57-50a863e44c12 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:36.712907 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-38d6e383-8204-4bc5-9d57-50a863e44c12 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:36.713790 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.objects.instance [None req-38d6e383-8204-4bc5-9d57-50a863e44c12 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lazy-loading 'fault' on Instance uuid 80a806f3-1568-4a25-8056-52c41a395be8 {{(pid=116675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 20 09:50:36.756180 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-38d6e383-8204-4bc5-9d57-50a863e44c12 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:50:36.763987 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-38d6e383-8204-4bc5-9d57-50a863e44c12 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 200 len: 1231 microversion: 2.1 time: 0.094598 Dec 20 09:50:36.764635 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 845/1723] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:50:36 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:50:37.780733 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9202f086-5534-404b-b895-385fc2b3b0b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:50:37.781435 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-9202f086-5534-404b-b895-385fc2b3b0b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: 80a806f3-1568-4a25-8056-52c41a395be8] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:50:37.788768 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9202f086-5534-404b-b895-385fc2b3b0b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:37.789216 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9202f086-5534-404b-b895-385fc2b3b0b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:37.789992 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9202f086-5534-404b-b895-385fc2b3b0b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:37.790423 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-9202f086-5534-404b-b895-385fc2b3b0b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:37.803742 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.wsgi [None req-9202f086-5534-404b-b895-385fc2b3b0b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] HTTP exception thrown: Instance 80a806f3-1568-4a25-8056-52c41a395be8 could not be found. Dec 20 09:50:37.804327 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-9202f086-5534-404b-b895-385fc2b3b0b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Returning 404 to user: Instance 80a806f3-1568-4a25-8056-52c41a395be8 could not be found. {{(pid=116674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:50:37.805137 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-9202f086-5534-404b-b895-385fc2b3b0b9 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8" status: 404 len: 111 microversion: 2.1 time: 0.028617 Dec 20 09:50:37.805662 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 879/1724] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:50:37 2021] GET /compute/v2.1/servers/80a806f3-1568-4a25-8056-52c41a395be8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:50:41.101971 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-6e35e523-d7da-40d4-8845-3d6214207625 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:50:41.102473 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6e35e523-d7da-40d4-8845-3d6214207625 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:50:41.104386 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-a85a4c70-bdfe-4769-a642-6b257d3e7c79 req-a52540ba-e845-4a20-94e2-ad7a007747a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c70e5477-8f9a-4f0b-955f-b4db76527c12", "tag": "78fbb9c4-f41d-47b0-80d1-4bb80500815c"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:50:41.106114 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:50:41.106114 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:50:41.109104 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6e35e523-d7da-40d4-8845-3d6214207625 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:41.109562 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6e35e523-d7da-40d4-8845-3d6214207625 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:41.110595 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6e35e523-d7da-40d4-8845-3d6214207625 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:41.111054 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-6e35e523-d7da-40d4-8845-3d6214207625 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:41.113620 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-a85a4c70-bdfe-4769-a642-6b257d3e7c79 req-a52540ba-e845-4a20-94e2-ad7a007747a9 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:41.114302 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-a85a4c70-bdfe-4769-a642-6b257d3e7c79 req-a52540ba-e845-4a20-94e2-ad7a007747a9 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:41.125406 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-a85a4c70-bdfe-4769-a642-6b257d3e7c79 req-a52540ba-e845-4a20-94e2-ad7a007747a9 service nova] Creating event network-changed:78fbb9c4-f41d-47b0-80d1-4bb80500815c for instance c70e5477-8f9a-4f0b-955f-b4db76527c12 on hv-cinder-81908 Dec 20 09:50:41.130515 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-a85a4c70-bdfe-4769-a642-6b257d3e7c79 req-a52540ba-e845-4a20-94e2-ad7a007747a9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030146 Dec 20 09:50:41.131757 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 880/1725] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:50:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:50:41.139013 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-6e35e523-d7da-40d4-8845-3d6214207625 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] Going to try to terminate instance {{(pid=116675) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 20 09:50:41.406433 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-6e35e523-d7da-40d4-8845-3d6214207625 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12" status: 204 len: 0 microversion: 2.1 time: 0.308492 Dec 20 09:50:41.410471 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 846/1726] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 20 09:50:41 2021] DELETE /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 20 09:50:41.418008 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-caacf4d5-e14e-42bc-9311-5bb5199433f5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:50:41.419321 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-caacf4d5-e14e-42bc-9311-5bb5199433f5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:50:41.426905 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-caacf4d5-e14e-42bc-9311-5bb5199433f5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:41.427631 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-caacf4d5-e14e-42bc-9311-5bb5199433f5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:41.428711 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-caacf4d5-e14e-42bc-9311-5bb5199433f5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:41.429393 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-caacf4d5-e14e-42bc-9311-5bb5199433f5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:41.616213 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.policy [None req-caacf4d5-e14e-42bc-9311-5bb5199433f5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116674) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:50:41.624090 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-caacf4d5-e14e-42bc-9311-5bb5199433f5 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12" status: 200 len: 1579 microversion: 2.1 time: 0.210975 Dec 20 09:50:41.624693 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 881/1727] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:50:41 2021] GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12 => generated 1579 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:50:42.641843 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-c19de26f-0a53-4293-80eb-4af990581189 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:50:42.643055 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-c19de26f-0a53-4293-80eb-4af990581189 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:50:42.649138 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c19de26f-0a53-4293-80eb-4af990581189 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:42.649512 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c19de26f-0a53-4293-80eb-4af990581189 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:42.650276 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c19de26f-0a53-4293-80eb-4af990581189 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:42.650707 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-c19de26f-0a53-4293-80eb-4af990581189 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:42.833620 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-c19de26f-0a53-4293-80eb-4af990581189 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:50:42.841731 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-c19de26f-0a53-4293-80eb-4af990581189 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12" status: 200 len: 1461 microversion: 2.1 time: 0.203876 Dec 20 09:50:42.842600 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 847/1728] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:50:42 2021] GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12 => generated 1461 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:50:43.670569 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [req-44e2b100-f343-4d72-81df-4a0b17ebfaf5 req-eedd603e-efc2-47e1-8f08-5157f66ba8a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c70e5477-8f9a-4f0b-955f-b4db76527c12", "name": "network-vif-deleted", "tag": "78fbb9c4-f41d-47b0-80d1-4bb80500815c"}]} {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 20 09:50:43.672213 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 09:50:43.672213 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: warnings.warn(msg) Dec 20 09:50:43.680123 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-44e2b100-f343-4d72-81df-4a0b17ebfaf5 req-eedd603e-efc2-47e1-8f08-5157f66ba8a7 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:43.686328 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [req-44e2b100-f343-4d72-81df-4a0b17ebfaf5 req-eedd603e-efc2-47e1-8f08-5157f66ba8a7 service nova] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:43.691228 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.compute.server_external_events [req-44e2b100-f343-4d72-81df-4a0b17ebfaf5 req-eedd603e-efc2-47e1-8f08-5157f66ba8a7 service nova] Creating event network-vif-deleted:78fbb9c4-f41d-47b0-80d1-4bb80500815c for instance c70e5477-8f9a-4f0b-955f-b4db76527c12 on hv-cinder-81908 Dec 20 09:50:43.696457 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [req-44e2b100-f343-4d72-81df-4a0b17ebfaf5 req-eedd603e-efc2-47e1-8f08-5157f66ba8a7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081615 Dec 20 09:50:43.697059 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 882/1729] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 20 09:50:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 20 09:50:43.859943 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-685ef45a-6f77-40cd-8797-9c615c107de2 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:50:43.860469 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-685ef45a-6f77-40cd-8797-9c615c107de2 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:50:43.867301 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-685ef45a-6f77-40cd-8797-9c615c107de2 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:43.867793 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-685ef45a-6f77-40cd-8797-9c615c107de2 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:43.868572 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-685ef45a-6f77-40cd-8797-9c615c107de2 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:43.869047 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-685ef45a-6f77-40cd-8797-9c615c107de2 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:43.933190 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.policy [None req-685ef45a-6f77-40cd-8797-9c615c107de2 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0bad80facd40ae8187b4c192c40ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55caff02fd494487955d97e9c4a5f9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116675) authorize /opt/stack/nova/nova/policy.py:199}} Dec 20 09:50:43.940899 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-685ef45a-6f77-40cd-8797-9c615c107de2 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12" status: 200 len: 1226 microversion: 2.1 time: 0.084756 Dec 20 09:50:43.941567 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 848/1730] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:50:43 2021] GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 20 09:50:44.959094 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-2bfc9c15-986f-487e-b6e0-344d85b01d8e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:50:44.959820 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-2bfc9c15-986f-487e-b6e0-344d85b01d8e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: c70e5477-8f9a-4f0b-955f-b4db76527c12] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:50:44.965884 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2bfc9c15-986f-487e-b6e0-344d85b01d8e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:44.966328 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2bfc9c15-986f-487e-b6e0-344d85b01d8e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:44.967092 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2bfc9c15-986f-487e-b6e0-344d85b01d8e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:44.967520 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-2bfc9c15-986f-487e-b6e0-344d85b01d8e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:44.981058 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.wsgi [None req-2bfc9c15-986f-487e-b6e0-344d85b01d8e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] HTTP exception thrown: Instance c70e5477-8f9a-4f0b-955f-b4db76527c12 could not be found. Dec 20 09:50:44.981628 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-2bfc9c15-986f-487e-b6e0-344d85b01d8e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Returning 404 to user: Instance c70e5477-8f9a-4f0b-955f-b4db76527c12 could not be found. {{(pid=116674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:50:44.982423 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-2bfc9c15-986f-487e-b6e0-344d85b01d8e tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12" status: 404 len: 111 microversion: 2.1 time: 0.028388 Dec 20 09:50:44.982979 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 883/1731] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:50:44 2021] GET /compute/v2.1/servers/c70e5477-8f9a-4f0b-955f-b4db76527c12 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:50:45.483978 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0a8a047c-f7ad-4a4f-9cef-f9accb07494f tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:50:45.485771 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.compute.api [None req-0a8a047c-f7ad-4a4f-9cef-f9accb07494f tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116675) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:50:45.491218 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0a8a047c-f7ad-4a4f-9cef-f9accb07494f tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:45.491671 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0a8a047c-f7ad-4a4f-9cef-f9accb07494f tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:45.492446 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0a8a047c-f7ad-4a4f-9cef-f9accb07494f tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:45.492874 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG oslo_concurrency.lockutils [None req-0a8a047c-f7ad-4a4f-9cef-f9accb07494f tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:45.506146 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.wsgi [None req-0a8a047c-f7ad-4a4f-9cef-f9accb07494f tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] HTTP exception thrown: Instance a2a4b0d6-febf-488e-978d-8f4c2b4102d5 could not be found. Dec 20 09:50:45.506722 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-0a8a047c-f7ad-4a4f-9cef-f9accb07494f tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Returning 404 to user: Instance a2a4b0d6-febf-488e-978d-8f4c2b4102d5 could not be found. {{(pid=116675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:50:45.507523 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-0a8a047c-f7ad-4a4f-9cef-f9accb07494f tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 404 len: 111 microversion: 2.1 time: 0.027234 Dec 20 09:50:45.508081 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 849/1732] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 20 09:50:45 2021] DELETE /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 20 09:50:45.515913 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f7797de1-db30-4860-a66c-f94d55a2e791 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '>' {{(pid=116674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:50:45.516519 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.compute.api [None req-f7797de1-db30-4860-a66c-f94d55a2e791 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] [instance: a2a4b0d6-febf-488e-978d-8f4c2b4102d5] Fetching instance by UUID {{(pid=116674) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 20 09:50:45.522216 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f7797de1-db30-4860-a66c-f94d55a2e791 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:45.522657 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f7797de1-db30-4860-a66c-f94d55a2e791 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:45.523420 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f7797de1-db30-4860-a66c-f94d55a2e791 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 09:50:45.523890 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG oslo_concurrency.lockutils [None req-f7797de1-db30-4860-a66c-f94d55a2e791 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Lock "f6e0e0af-77e8-4802-8159-a0a3ab8beb6c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 09:50:45.536657 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.wsgi [None req-f7797de1-db30-4860-a66c-f94d55a2e791 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] HTTP exception thrown: Instance a2a4b0d6-febf-488e-978d-8f4c2b4102d5 could not be found. Dec 20 09:50:45.537223 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: DEBUG nova.api.openstack.wsgi [None req-f7797de1-db30-4860-a66c-f94d55a2e791 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Returning 404 to user: Instance a2a4b0d6-febf-488e-978d-8f4c2b4102d5 could not be found. {{(pid=116674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 20 09:50:45.538014 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO nova.api.openstack.requestlog [None req-f7797de1-db30-4860-a66c-f94d55a2e791 tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5" status: 404 len: 111 microversion: 2.1 time: 0.025689 Dec 20 09:50:45.538530 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: [pid: 116674|app: 0|req: 884/1733] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 20 09:50:45 2021] GET /compute/v2.1/servers/a2a4b0d6-febf-488e-978d-8f4c2b4102d5 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 20 09:50:46.989069 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: DEBUG nova.api.openstack.wsgi [None req-508a2861-1e42-4b15-a5d8-02635cb6ccca tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] Calling method '.version_select at 0x7f9153924670>' {{(pid=116675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 20 09:50:47.066043 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO nova.api.openstack.requestlog [None req-508a2861-1e42-4b15-a5d8-02635cb6ccca tempest-TestVolumeBootPattern-1954545405 tempest-TestVolumeBootPattern-1954545405-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2061179994" status: 202 len: 0 microversion: 2.1 time: 0.080401 Dec 20 09:50:47.066626 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: [pid: 116675|app: 0|req: 850/1734] 10.222.0.62 () {58 vars in 1262 bytes} [Mon Dec 20 09:50:46 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2061179994 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 20 09:51:40.231553 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 20 09:51:40.232206 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: Mon Dec 20 09:51:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 20 09:51:52.304232 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 20 09:51:52.304900 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: Mon Dec 20 09:51:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 20 09:53:18.614953 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 20 09:53:18.615556 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: Mon Dec 20 09:53:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 20 09:53:34.914887 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 20 09:53:34.915496 dv-cinder-819082-2-iscsi devstack@n-api.service[116675]: Mon Dec 20 09:53:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 20 09:53:37.223996 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 20 09:53:37.224577 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: Mon Dec 20 09:53:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 20 09:55:00.239638 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 20 09:55:00.240426 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: Mon Dec 20 09:55:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 20 09:55:12.311822 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 20 09:55:12.312621 dv-cinder-819082-2-iscsi devstack@n-api.service[116674]: Mon Dec 20 09:55:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!